ibmpublic.dhe.ibm.com/support/knowledgecenter/storediq/... · 2019. 12. 12. · getting started...

614
Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ hardware and software requirements Overview of IBM StoredIQ Data Workbench Common tasks Infoset management Administering filters Exploring infosets and data Enhancing infosets Configuring actions on your data Creating data reports Viewing exceptions Troubleshooting and support Support for IBM Unstructured Data Identification and Management IBM Unstructured Data Identification and Management fixes IBM Software Support home page More information Information lifecycle governance Enterprise content management IBM Unstructured Data Identification and Management v7.5.1 documentation Welcome to the IBM® Unstructured Data Identification and Management documentation, where you can find information about how to deploy, maintain, and use IBM Unstructured Data Identification and Management.

Upload: others

Post on 02-Jan-2021

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Gettingstarted

OverviewoftheIBMStoredIQcomponents

DeploymentofIBMStoredIQPlatform

IBMStoredIQhardwareandsoftwarerequirements

OverviewofIBMStoredIQDataWorkbench

Commontasks

Infosetmanagement

Administeringfilters

Exploringinfosetsanddata

Enhancinginfosets

Configuringactionsonyourdata

Creatingdatareports

Viewingexceptions

Troubleshootingandsupport

SupportforIBMUnstructuredDataIdentificationandManagement

IBMUnstructuredDataIdentificationandManagementfixes

IBMSoftwareSupporthomepage

Moreinformation

Informationlifecyclegovernance

Enterprisecontentmanagement

IBMUnstructuredDataIdentificationandManagementv7.5.1documentation

WelcometotheIBM®UnstructuredDataIdentificationandManagementdocumentation,whereyoucanfindinformationabouthowtodeploy,maintain,anduseIBMUnstructuredDataIdentificationandManagement.

Page 2: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

IBMUnstructuredDataIdentificationandManagement 1IBMStoredIQPlatformoverview 2OverviewoftheIBMStoredIQcomponents 4ComponentsoftheIBMStoredIQsolution 5IBMStoredIQinterfacecomponents 6IBMStoredIQAdministrator 8IBMStoredIQDataWorkbench 9IBMStoredIQDataWorkbenchsupport 10

IBMStoredIQeDiscovery 11IBMStoredIQDataScript 12IBMStoredIQPolicyManager 13

Notices 14Privacypolicyconsiderations 16Termsandconditionsforproductdocumentation 17Trademarks 18

DeployingandconfiguringIBMStoredIQPlatform 19IBMStoredIQcomponents 20ComponentsoftheIBMStoredIQsolution 21IBMStoredIQproducts 22

Deploymentpreparation 23Deploymentplanning 24OpenVirtualAppliance(OVA)configurationrequirements 25Networkandportrequirements 27Environmentsizingguidelines 28

Stack-provisioningprerequisites 30DeploymentofIBMStoredIQPlatform 31OpenVirtualizationFormat(OVF) 32Deployingthevirtualappliances 33

InstallationofIBMStoredIQPlatform 34Installingthegatewayanddataservers 35

ConfigurationofIBMStoredIQPlatform 36Configuringthegateway 37ConfiguringIBMStoredIQPlatformdataserver 38Configuringtheapplicationstack 39NetworkConfiguration 40AppstackConfiguration 41CertificateConfiguration 42

InstallingIBMDesktopDataCollector 44CreatingatemplatefromtheIBMStoredIQOVA 45EditingtheOVFfile 46Applicationdatamigration 47Migratingdataofthedataserver 48Migratingdataofthegateway 49Migratingdataoftheapplicationstack 50Enablingpublicorprivateinfosets 51

Customizablereports 53InstallingtheBIRTReportDesigner 55InstallingtheJDBCdriver 56Addingdatasources 57

Tableofcontents

Page 3: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Settingreportparameters 58

Addingdatasets 59Testingreportdesigns 60

Uploadingthereportdesign 61Deployingfonts 62Changingthereportuserpassword 63

InstallingtheLivelinkAPIs 64AdministeringIBMStoredIQ 65AdministeringIBMStoredIQAdministrator 66OverviewofIBMStoredIQAdministrator 67Switchingbetweenapplications 68

DataServersandVolumes 69Searchingforaspecificdataserver 71Addingaprimaryvolume 72Addingaretentionvolume 75Addingadiscoveryexportvolume 76Viewingdetailsofadataserver 77Viewingperformanceofadataserver 78

Systeminfosets 79Searchingforaspecificinfoset 80Creatingasysteminfoset 81Editingasysteminfoset 82Viewinginfosetsthatuseasysteminfoset 83Viewingaccessmembers 84Deletingasysteminfoset 85

Usermanagement 86Viewingyouruserprofile 87Searchingforaspecificuser 88Creatingauser 89Editingauser 90Viewingdetailsofauser 91Deletingauser 92Changingtheuserpasswords 93Resettingtheuserpassword 94Obtaininganewpassword 95

Actionmanagement 96Searchingforaspecificaction 97Creatinganaction 98Deletinganaction 101Cloninganaction 102Editinganaction 103

Targetsets 104Searchingforaspecifictargetset 105Creatingatargetset 106Editingatargetset 107Cloningatargetset 108Deletingatargetset 109

Reports 110Searchingforaspecificreport 111Creatingareport 112

Page 4: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Auto-classificationmodels 113

Applyingtheauto-classificationfeature 115Dataserversizing-configurationguidelines 116Downloadingtheclassificationexportutility 117Buildinganauto-classificationmodel 118PreparinganIBMContentClassificationmodelforimport 119Importinganauto-classificationmodel 120Searchingforaspecificclassificationmodel 121Editingamodel 122Deletingamodel 123

Conceptmanagement 124Addingamembertoaconcept 125Searchingforaconcept 126Editingamemberofaconcept 127Deletingamemberofaconcept 128

AdministeringIBMStoredIQPlatformDataServer 129IBMStoredIQPlatformuserinterface 130NavigationwithinIBMStoredIQPlatform 131Webinterfaceicons 133

Systemadministration 134Checkingthesystem'sstatus 135Restartingthesystem 137

ConfigurationofIBMStoredIQPlatform 138ConfiguringDAGatewaysettings 140Configuringnetworksettings 141Configuringmailsettings 142ConfiguringSNMPsettings 143ConfiguringnotificationfromIBMStoredIQPlatform 145Settingthesystemtimeanddate 146Settingsystembackupconfigurations 147Usermanagement 148Logginginandoutofthesystem 149Changingtheadministrativeaccount 150Creatingusers 151Editingusers 152Deletingauser'saccount 153Lockingauser'saccount 154Managingauser'saccount 155

ImportingencryptedNSFfilesfromLotusNotes 156Configuringharvestersettings 157Opticalcharacterrecognitionprocessing 159

Configuringfull-textindexsettings 160Specifyingdataobjecttypes 162Configuringauditsettings 163Configuringhashsettings 164Configuringdesktopsettings 165DownloadingtheIBMDesktopDataCollectorinstallerfromtheapplication 166UpgradingtheIBMDesktopDataCollectoragent 167ManagingtheEncryptedfilesystemrecoveryagent 168

Volumesanddatasources 169

Page 5: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Volumeindexing 170

Serverplatformconfiguration 171ConfiguringWindowsShare(CIFS) 172ConfiguringNFS 173ConfigurationofExchangeservers 174EnablingintegratedWindowsauthenticationonExchangeservers 175ImprovingperformanceforIIS6.0andExchange2003 176

ConfigurationofSharePoint 177ConfiguringDocumentum 179ConfiguringEnterpriseVaultsites 180ConfigurationofDiscoveryAccelerator 181ConfiguringsecuritysettingsforEnterpriseVaultservers 183

ConfiguringNewsGator 184Configurationofretentionservers 185CreatingCenterapools 186ConfiguringtheDellDXObjectStoragePlatform 187ConfiguringEnterpriseVault 188ConfiguringIBMInformationArchiveRetentionServers 190NetAppSnapLock 192HitachiHCAPconfigurationrequirements 193

Creatingprimaryvolumes 194ConfiguringExchange2007ClientAccessServersupport 218AddingDominoasaprimaryvolume 219Specialnote:SharePointvolumes 220ConfiguringFileNet 221ConfiguringChattermessages 222

Creatingretentionvolumes 223Addingaretentionvolume 224ConfiguringEnterpriseVaultretentionvolumes 234

Creatingdiscoveryexportvolumes 235Creatingsystemvolumes 238Exportandimportofvolumedata 241Deletingvolumes 244Policylimitationsforvolumetypes 245

Dataharvesting 248Harvestingpropertiesandlibraries 249Lightweightharvestparametersettings 250Determiningvolumeconfigurationsettings 251Determiningharvesterconfigurationsettings 252Determiningfull-textsettings 253Determininghashsettings 254

Jobconfiguration 255Creatingajob 257Creatingajobtodiscoverretentionvolumes 258Editingajob 259Startingajob 260Savingajob 261Runningapredefinedjob 262Deletingajob 263Monitoringprocessing 264

Page 6: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Deletingavolumecache 266

Determiningwhetheraharvestisstuck 267Desktopcollection 268IBMDesktopDataCollectorclientinstallation 269IBMDesktopDataCollectorinstallationmethods 270ConfiguringtheIBMDesktopDataCollectorcollection 272Deletepolicy:specialnotes 273

Folders 274Creatingafolder 275Deletingafolder 276Movingafolder 277Renamingafolder 278Copyingitemstodifferentfolders 279Savingitemsintodifferentfolders 280Filteringitemswithinthefolderview 281

Auditsandlogs 282Harvestaudits 283Viewingharvestaudits 286Downloadingharvestlistdetails 287

Importaudits 288Viewingvolumeimportauditdetails 289

Eventlogs 290Viewingeventlogs 291Subscribingtoanevent 292Clearingthecurrenteventlog 293Downloadinganeventlog 294

Policyaudits 295Viewingpolicyauditdetails 298Viewingapolicyauditbyname 300Viewingapolicyauditbyvolume. 301Viewingapolicyauditbytime 302Viewingapolicyauditbydiscoveryexport 303

Searchauditfeature 304Savingresultsfromanaudit 305Policyauditmessages 306

Deployingcustomizedwebservices 308Uninstallinganexistinginstanceofthewebservice 309Verifyingthelocationofthehostedwebservice 310Configuringadminknobs 311

Supportedfiletypes 313Supportedfiletypesbyname 314Supportedfiletypesbycategory 323SharePointattributes 334

Supportedserverplatformsandprotocols 336Eventlogmessages 341ERROReventlogmessages 342INFOeventlogmessages 354WARNeventlogmessages 366

ManagingtheIBMStoredIQproducts 375ManagingIBMStoredIQDataScript 376

Page 7: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

OverviewofIBMStoredIQDataScript 377

Documentdashboardview 378Workfloworigination 379Addingadocument 380Searchingforadocument 381Viewingadocument 382Documentsdetails 383Runningaworkflow 385

ManagingIBMStoredIQDataWorkbench 386OverviewofIBMStoredIQDataWorkbench 387KeyconceptsofIBMStoredIQDataWorkbench 388Informationset 389IBMStoredIQPlatformindex 391Filter 392Overlay 393Scopeoperation 394Action 395Report 396

Infosetmanagement 397Creatinganinfoset 398Interruptinginfosetcreation 399Searchingforaspecificinfoset 400Creatinganoverlay 401Editinganinfoset 402Deletinganinfoset 403Viewoftheinfosetdetails 404Viewinginfosetancestry 405Savinginfosetancestryasaworkflow 406Executionlog 407Viewingactionlogofinfosets 408Generatinganauditreport 409Viewingdataobjects 410

Filteradministration 411Libraryofavailablefilters 412Searchingforanexistingfilter 413Editingafilter 414Viewingfiltercode 415Deletingafilter 416Buildingafilter 417Creatingafilefilter 419Creatingadatefilter 420Creatingasizefilter 421Creatinganamefilter 422Creatinganemailfilter 423Creatingafull-textfilter 424Creatinganauto-classificationfilter 425Creatingcustomizedsearcheswiththecodeview 426Syntaxprimer 427

Previewingfilterresults 429Configuringcolumnswhenpreviewingfilterresults 430

Page 8: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Setoperations 431

Creatingaunioninfoset 433Creatinganintersectioninfoset 434Creatinganinfosetwithasymmetricdifference 435Creatingasubtractioninfoset 436

Scopeoperations 437Expandingahierarchy 438Collapsingahierarchy 439

Enhancementstoinfoset 440Runninganenhancement 441Searchingforaspecificenhancement 442

Actionsondata 443Searchingforaspecificaction 444Schedulingandrunninganaction 445Cancelingascheduledaction 446

Explorationofinfosetsanddata 447Datamaps 448Groupinganinfosetbydatasourcetype 451Viewingdatawithdifferentviews 452Selectingadataoverlay 454DownloadingCSVdata 455

Exceptions 456Searchingforaspecificexceptionobjects 458Viewingexceptionobjectdetails 459Exportingtheexceptionobjectlist 460

Filterconditionreferenceandexpressionlanguage 461Full-textsyntax 462Full-textmacros 465ExtendedASCIIcharacters 466Attributeconditionreference 468Specificationofattributeconditions 469Conditionsforstringattributes 470Conditionsforenumerationattributes 471Conditionsfordateattributes 472Conditionsfornumberattributes 473Conditionsforsparseattributes 474Conditionsforcompoundattributes 475Conditionsformultivaluedattributes 476Accessmodeattributes 477

Typeofobjecttomatch 478Multiplematchingvaluesforoperators 479At-leastexpressions 480Parentandchildconditions 481No-inheritanceconditions 483Analyticsfilterexpressions 484

IBMDiscoveryExportEDRMXML 485Filesystemdirectorylayout 486Sourcevolumefiles 487EDRMXMLproduction 488

EDRMXMLconsiderations 491

Page 9: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

XMLrootinformation 492

Batchinformation 493Documententriesintheloadfile 494Taginformation 495Relationshipbetweendocuments 496

EDRMXMLmetadatatags 497Metadatabyattributetype 507Systemmetadataattributes 509Documentumservermetadataattributes 512Centeraservermetadataattributes 516DellDXObjectStoragePlatformmetadataattributes 518IBMInformationArchiveServermetadataattributes 520HitachiHCAPServermetadataattributes 522NetAppSnapLockServermetadataattributes 524ExchangeServermetadataattributes 526DiscoveryAcceleratormetadataattributes 528FileNetmetadataattributes 530Emailmetadataattributes 533Dataobjectpropertyattributes 537SharePointattributes 539Calendarmetadataattributes 541Contactmetadataattributes 542Digitalsignaturesmetadataattributes 544Processingmetadataattributes 545Taskmetadataattributes 547Attributevaluetypes 548IBMLotusNotesmetadataattributes 550Enterprisevaultmetadataattributes 553Jivemetadataattributes 555Chattermetadataattributes 557

ManagingIBMStoredIQeDiscovery 559OverviewofIBMStoredIQeDiscovery 560Switchingbetweenapplications 561

Actionsonamatter 562MatterDashboardview 563Viewofamatter 564Emailingthecontactpersonofamatter 565Filteringforamatter 566Addingamatter 567Deletingamatter 568

Matterconfiguration 569Editingamatter 570Creatingabox 571Editingthesummaryofabox 574Datamaps 575Viewingthefilelistordatamap 577

Actionsonabox 578Refiningabox 579Restartingabox 580Cloningabox 581

Page 10: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Creatingacollectionbox 582

Creatinganexportbox 583Reports 584Runningareportonabox 586Deletingabox 587

ManagingIBMStoredIQPolicyManager 588OverviewofIBMStoredIQPolicyManager 589IBMStoredIQPolicyManageradministration 590PolicyDashboardview 591Creatingapolicy 593Viewingapolicy 594Enablingordisablingapolicy 596Emailingacontactperson 597Deletingapolicy 598

Actionsonapolicy 599Editingapolicy 600Runningapolicy 601Runningareport 602Viewingapolicyreport 603Deletingarun 604Stoppingarun 605

IBMUnstructuredData751, p. 1

Page 11: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

IBMStoredIQPlatformoverviewIBM®StoredIQPlatformprovidesscalableanalysisandgovernanceofunstructureddatain-placeacrossdisparateanddistributedemail,fileshares,desktops,andcollaborationsites.Itsproductsenablecompaniestodiscover,analyze,andactondataforeDiscovery;recordsretentionanddisposition;compliance;andstorageoptimizationinitiatives.

Powerfulsolutionsformanagingunstructureddatain-placeIBM®UnstructuredDataIdentificationandManagementaddressestheproblemsthatchallengerecordsmanagement,electronicdiscovery,compliance,storageoptimization,anddatamigrationinitiatives.Byprovidinganin-depthassessmentofunstructureddatawhereitis,thissoftwaregivesorganizationsvisibilityintodatatomakemoreinformedbusinessandlegaldecisions.UnstructuredDataIdentificationandManagementdelivers:

In-placedatamanagementthatallowsanorganizationtodiscover,recognize,andactonunstructureddatawithoutmovingittoarepositoryorspecialtyapplication.Apowerfulsearchfunctionthatacceleratestheunderstandingoflargeamountsofunstructuredcontent.Simplifiedanalysisoflargeamountsofcorporatedatatoprovidedetailedanalysisfasterandlimittheimpactonuserproductivitybyanalyzingandmanagingdatain-place.Intelligencethatsupportsmanydifferentpolicyactionssuchascopy,delete,move,copytoretention,orexport.

Anorganized,systemic,anddefensibleapproachtoeDiscoveryIBM®eDiscoveryIdentificationandCollectionprovidesinsightintoenterprisedatatohelpeasethecostsandeffortsthatareinvolvedinelectronicdiscovery(eDiscovery)response.Thissoftwarehelpsdecreasethevolumeofunstructureddatabytargetingonlythemostrelevantinformationtoaparticularcaseandprovidingforensicallysoundanddefensiblecollections.eDiscoveryIdentificationandCollectiondelivers:

Fasteraccesstorelevantinformationbeforecollection,givinglegalandITteamsthedatathatisneededtomakemoreinformedlegaldecisions.Apowerfulsearchfunctionthatacceleratestheunderstandingoflargeamountsofunstructuredcontentandencouragesorganizationalalignmentthatcanleadtoreducedlegalrisksandcosts.Simplifiedanalysisoflargeamountsofcorporateelectronicallystoredinformation(ESI),providingfasterdetailedanalysis,andlimitingtheimpactonuserproductivity.Intelligencethatallowscompaniestorespondmorequicklytolitigationwiththemostrelevantdata.

InformationgovernancetoautomatepolicyandcomplianceacrossunstructureddataIBM®PolicyAssessmentandCompliancehelpsorganizationsidentify,classify,andmanageenterpriseinformationaccordingtobusinessvaluetoreduceriskandcost.Corporationscangainadeeperandholisticunderstandingoftheirunstructureddatatoaddressbusinessandregulatoryrequirements,complianceenforcement,dataretentionandrespondtoauditrequests.PolicyAssessmentandComplianceprovidesthefollowingfeaturesandsolutions:

Apowerfuldataassessmentsolutionfordiscovering,recognizing,andactingonunstructureddatawithoutfirstmovingittoarepository.Advancedsearchcapabilitiesthataretailoredtohelplegal,records,compliance,andITstaffdiscoverdatainaccordancewithcorporateandregulatorypolicy.Detaileddataanalysistosimplifytheanalysisoflargeamountsofcorporatedata.In-placedatamanagementcapabilitiestoremediateregulatoryandcorporatepolicyviolations.

Flexiblesolutionforidentifyingandcollectingdatafromremotedevices

IBMUnstructuredData751, p. 2

Page 12: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

IBM®DesktopDataCollectorenablesorganizationstoapplycorporategovernancepoliciestouserdesktopsandnotebooks.Userscanidentifycorporaterecordsorcustodiandataforlegalmattersandcollectthemtoacentralrepositorybuiltfordeviceswithintermittentconnectivity.DesktopDataCollectordelivers:

Apowerful,flexiblesolutionforidentifyingandcollectingdataforinvestigations,litigationmatters,orrecordsretention.Asimplifiedcollectionofinformationonremotedesktopsandnotebooks.CentralizedmanagementtominimizeITburdenandimproveefficiencywhenusedwithIBMeDiscoveryIdentificationandCollectionorIBMPolicyAssessmentandCompliance.Intelligentdesktopdatacollectionforidentifyingcorporaterecordsorcustodiandataandcollectingthemtoacentralrepository.

OverviewoftheIBMStoredIQcomponentsThefollowingsectionsdescribethreecomponentsoftheIBMStoredIQsolutionandtheinterfacesthatIBMStoredIQproductsprovidetousetheservicesoftheIBMStoredIQPlatform.

IBMUnstructuredData751, p. 3

Page 13: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

OverviewoftheIBMStoredIQcomponentsThefollowingsectionsdescribethreecomponentsoftheIBM®StoredIQsolutionandtheinterfacesthatIBMStoredIQproductsprovidetousetheservicesoftheIBMStoredIQPlatform.

ComponentsoftheIBMsolutionThethreecomponentsoftheIBMStoredIQsolutionarethegateway,dataservers,andapplicationstack(AppStack).IBMStoredIQinterfacecomponentsTheIBMStoredIQproductcomponentsincludeIBMStoredIQAdministrator,IBMStoredIQDataWorkbench,IBMStoredIQeDiscovery,IBMStoredIQDataScript,IBMStoredIQPolicyManager,andIBMDesktopDataCollector.Notices

IBMUnstructuredData751, p. 4

Page 14: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ComponentsoftheIBMsolutionThethreecomponentsoftheIBM®StoredIQsolutionarethegateway,dataservers,andapplicationstack(AppStack).

TheGatewayThegatewaycommunicatesbetweenthedataserversandtheapplicationstack.Theapplicationstackpollsthegatewayforinformationaboutthedataonthedataservers.Thedataserverspushtheinformationtothegateway.

DataServersTheIBMStoredIQDataServerhelpsunderstandthedatalandscapeoftheenterprise.Itobtainsthedatafromsupporteddatasourcesandindexesit.Byindexingthisdata,yougaininformationaboutunstructureddatasuchasfilesize,filedatatypes,fileowners.Thedataserverspushtheinformationaboutvolumesandindexestothegatewaysoitcanbecommunicatedtotheapplicationstack.Multipledataserversfeedintoasinglegateway.Inadditiontoanadministratoruserinterface,administratorscandeploytheIBMDesktopDataCollectorandindexdesktopsfromthedataserver.

ApplicationstackTheapplicationstackprovidestheuserinterfacefortheIBMStoredIQAdministrator,IBMStoredIQDataWorkbench,IBMStoredIQeDiscovery,IBMStoredIQDataScript,andtheIBMStoredIQPolicyManagerproducts.

Parenttopic:OverviewoftheIBMStoredIQcomponents

IBMUnstructuredData751, p. 5

Page 15: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

IBMStoredIQinterfacecomponentsTheIBM®StoredIQproductcomponentsincludeIBMStoredIQAdministrator,IBMStoredIQDataWorkbench,IBMStoredIQeDiscovery,IBMStoredIQDataScript,IBMStoredIQPolicyManager,andIBMDesktopDataCollector.

IBMStoredIQAdministratorIBMStoredIQAdministratormonitorsandmanagesthedistributedinfrastructureataclientsite.IBMStoredIQAdministratorsitsbetweentheIBMStoredIQPlatforminterfaceandtheapplicationsandfacilitatesthetransferandcommunicationofinformation.IBMStoredIQAdministratorunderstandsandmanagesIBMStoredIQPlatformconceptssuchasvolumes,indexes,harvests,andconfigurations.Atthesametime,itmanagestheapplicationconcernssuchasinfosetlifecycleandcreation,volumeconfiguration,andactionandtarget-setmanagement.Tothisend,itisdividedintotwosections,thatis,platformandapplication,sothattheadministratorsknowwheretoaccomplishatask.

IBMStoredIQDataWorkbenchWithIBMStoredIQDataWorkbench,youcanvisualizetheindexeddataandidentifypotentialred-flagissuestoknowhowmuchandwhattypesofdatayouhaveondifferenttypesofservers.Italertspeopleaboutpotentiallyinterestingorusefuldata.Ithelpsensurethatthedataofanenterpriseisanasset,notaliability.

IBMStoredIQeDiscoveryIBMStoredIQeDiscoveryisintegraltotheeDiscoveryprocess.Ithelpsdiscover,identify,refine,preserve,andcollectdatathatisrelevanttolegalmatters.WithIBMStoredIQeDiscovery,youcanconductdiscoveryworkmoreefficientlyandensurethatyoucapturetheappropriatedataatthesametime.

IBMStoredIQDataScriptIBMStoredIQDataScriptautomatesexecutionwithinIBMStoredIQPlatform.Therefore,youcanscript,automate,andmonitorprocessesthatotherwisenormallyaremanualprocessesthatarerunwithinIBMStoredIQDataWorkbench.IBMStoredIQDataScriptfocusesonrepeatable,understood,andapprovedprocessesforthepurposesofcullingandrefiningdatainanapprovedmanner.

IBMStoredIQPolicyManagerIBMStoredIQPolicyManageractsondatainanautomaticfashionatscale,runningpoliciesthataffectdataobjectswithoutrequiringreview.

IBMDesktopDataCollectorIBMDesktopDataCollectordeploysfromtheIBMStoredIQPlatformDataServerAdministratorinterface.Itindexesdesktopsasvolumes.ThevolumesappearintheDataServerAdministratorinterfaceandIBMStoredIQDataWorkbench,wherethedatacanbeanalyzedandactedupon,andtheIBMStoredIQAdministratorapplication.

IBMStoredIQPlatformusesanon-invasivedeployment,specifically:

Lightweightclientdeploymentwithnobrowserplug-insandnoclient-sideUIinstallations.Allmajorbrowsers,suchasInternetExplorerandFirefox,aresupportednatively.One(common)indexthatissharedacrossallusecases.Thisindexsupportsawidevarietyofdatasourcesandisusedbyapplicationdashboardsformanyusecases.Noagentsareplacedondatasources.ThenativeAPI/protocolisusedwheneveritispossible.Third-partyorcustomconnectorsareusedonlywhennecessary.Note:Agentsareusedfordesktopcollection.

IBMStoredIQAdministratorIBMStoredIQAdministratorhelpsyoutomanageglobalassetscommontothedistributedinfrastructurebehindIBMStoredIQPlatformapplications.IBMStoredIQDataWorkbenchThefollowingsectionprovidesahigh-levelexplanationofwhatIBMStoredIQDataWorkbenchisanditspotentialuses.IBMStoredIQeDiscoveryThefollowingsectionprovidesahigh-levelexplanationofwhatIBMStoredIQeDiscovery

IBMUnstructuredData751, p. 6

Page 16: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

is,bywhomitisused,prerequisites,anditspotentialuses.IBMStoredIQDataScriptThroughtheIBMStoredIQDataScriptinterface,youcanmonitoreachofthestepsastheyarerun.Then,youviewanydefinedoutputs,suchasreports,infosets,orexportsthataregeneratedasaresult.ByrunningIBMStoredIQDataWorkbenchworkflows,theusercanreapplyprocessesthatwerereviewedandapprovedtoapplytoawidevarietyofdifferentdataproblems.IBMStoredIQPolicyManagerIBMStoredIQPolicyManagerenablespolicyexecutionatscale.

Parenttopic:OverviewoftheIBMStoredIQcomponents

IBMUnstructuredData751, p. 7

Page 17: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

IBMStoredIQAdministratorIBM®StoredIQAdministratorhelpsyoutomanageglobalassetscommontothedistributedinfrastructurebehindIBMStoredIQPlatformapplications.

IBMStoredIQAdministratorprovidesat-a-glanceunderstandingofthedifferentissuesthatcancropupintheIBMStoredIQPlatformenvironment.TheseviewsareuniquetotheIBMStoredIQAdministratorapplicationastheyprovideanoverviewofhowthesystemisrunning.Theyallowaccesstovariouspiecesofinformationthatarebeingsharedacrossapplicationsorallowforthemanagementofresourcesinacentralizedmanner.

TheadministratoristhepersonresponsibleformanagingtheIBMStoredIQPlatform.Thisindividualhasstrongunderstandingofdatasources,indexes,dataservers,jobs,infosets,andactions.ThislistprovidesanoverviewastohowIBMStoredIQAdministratorworks:

Viewingdataserversandvolumes:UsingIBMStoredIQAdministrator,theAdministratorcanidentifywhatdataserversaredeployed,theirlocation,whatdataisbeingmanaged,andthestatusofeachdataserverinthesystem.VolumemanagementisacentralcomponentofIBMStoredIQPlatform.IBMStoredIQAdministratoralsoallowstheAdministratortoseewhatvolumesarecurrentlyundermanagement,whichdataserverisresponsibleforthatvolume,thestateofthevolumeafterindexing,andtheamountandsizeofinformationthatiscontainedbyeachvolume.Administratorscanalsoaddvolumestodataserversthroughthisinterface.Creatingsysteminfosets:SysteminfosetsthatuseonlyspecificindexedvolumescanbecreatedandmanagedwithinIBMStoredIQAdministrator.AlthoughinfosetsareacorecomponentofIBMStoredIQDataWorkbench,systeminfosetsarecreatedasashortcutforusersinIBMStoredIQAdministrator.Managingusers:Theusermanagementareaallowsadministratorstocreateusersandmanageusers'accesstothevariousIBMStoredIQapplications.Configuringandmanagingactions:Anactionisanyprocessthatistakenuponthedatathatisrepresentedbytheindexes.Actionsarerunbydataserversonindexeddataobjects.AnyerrorsorwarningsthataregeneratedasaresultofanactionarerecordedasexceptionsinIBMStoredIQDataWorkbench.Note:ActionscanbecreatedwithinIBMStoredIQAdministratorandthenmadeavailabletootherIBMStoredIQapplicationssuchasIBMStoredIQDataWorkbench.Managingtargetsets:Providesaninterfacethatallowstheusertosetthewantedtargetsforspecificactionsthatrequireadestinationvolumefortheiractions.Managingconcepts:Youcanrelatebusinessconceptstoindexeddata.

Parenttopic:IBMStoredIQinterfacecomponents

IBMUnstructuredData751, p. 8

Page 18: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

IBMStoredIQDataWorkbenchThefollowingsectionprovidesahigh-levelexplanationofwhatIBM®StoredIQDataWorkbenchisanditspotentialuses.

Bigdataisapervasiveproblem,notaone-timeoccurrence.Itiseasyformostcompaniestorealizethatbigdataisproblematic,butitishardtoidentifywhatproblemstheyhave.Bigdataisallabouttheunknown,buttheunknowncannotbeofflimits.IBMStoredIQDataWorkbenchcanhelpyoulearnaboutyourdata,makeeducateddecisionswithyourmostvaluableasset,andturnyourcompany'smostdangerousriskintoitsmostvaluableasset.

IBMStoredIQDataWorkbenchisadatavisualizationandmanagementtoolthathelpsyoutoactivelymanageyourcompany'sdata.Ithelpsyoutodeterminehowmuchdatayouhave,whereitis,whoownsit,andwhenitwaslastused.Whenyouhaveaclearunderstandingofyourcompany'sdatalandscape,IBMStoredIQDataWorkbenchhelpsyoutakecontrolofdata.Youcanmakeinformeddecisionsaboutyourdataandactonthatknowledgebycopying,copyingtoretention,orconductingadiscoveryexport.

HerearejustsomeoftheexamplesthatyoucanuseIBMStoredIQDataWorkbench.

YouneedtofindallcompanyemailthatissentfromorreceivedbyEileenSideways([email protected]).YoucanuseIBMStoredIQDataWorkbenchtofindallemailandthencopythatdatatoapredefinedrepository.YoucanalsouseIBMStoredIQDataWorkbenchtofindalloftheesideways@thecompany.comemailthatoccurredbetweenspecificdatesandthenmakethatemailavailableforreview.Asanadministrator,youwanttoridyournetworksandstorageofunuseddata.YoucanuseIBMStoredIQDataWorkbenchtofindallfilesthatwerenotmodifiedinmorethanfiveyears.Youwanttofindallimagefilesthatarecreatedin2007.NotonlycanIBMStoredIQDataWorkbenchfindallimagefilesthatwerecreatedin2007.Italsoshowshowmuchspacetheyoccupyonyournetwork.AuserneedstounderstandhowdataaboutWindowsisbeingretained.UsingIBMStoredIQDataWorkbench,youcanprovidethatuserwithavisualoverviewofthenumberofobjectsthatareretainedandabreakdownoffilesperdatasource.Additionally,youcanapplyoverlaystoshowtheuserifthosefilescontainforbiddeninformationsuchascredit-cardnumbersorSocialSecuritynumbers.

IBMStoredIQDataWorkbenchsupport

Parenttopic:IBMStoredIQinterfacecomponents

IBMUnstructuredData751, p. 9

Page 19: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

IBMStoredIQDataWorkbenchsupportIBM®StoredIQPlatformhelpsyoutotrulyunderstandyourcompany'sdatalandscape.UsingIBMStoredIQPlatformdataserver,allunstructureddatainacompany'senterprisenetworkisindexed.Byindexingthisdata,yougaininformationaboutunstructureddatasuchasfilesize,filedatatypes,fileowners.

IBMStoredIQDataWorkbenchisthetoolthatyouusetovisualizethisindexeddata,helpingyoutoidentifypotentialred-flagissues,toknowhowmuchdatayouhaveondifferentservers,andtoalertpeopleaboutpotentiallyinterestingorusefuldata.

Parenttopic:IBMStoredIQDataWorkbench

IBMUnstructuredData751, p. 10

Page 20: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

IBMStoredIQeDiscoveryThefollowingsectionprovidesahigh-levelexplanationofwhatIBM®StoredIQeDiscoveryis,bywhomitisused,prerequisites,anditspotentialuses.

IBMStoredIQeDiscoveryisauserapplicationthathelpslegalusersduringtheinitialphasesoftheeDiscoveryprocess.Byhelpingyoutocaptureneededelectronicdata,youcanuseIBMStoredIQeDiscoverytocommunicateeasilywithotherusersaboutthestatusandreviewprocessofworkthatisbeingdone.IBMStoredIQeDiscoverydoesnotdrivetheeDiscoveryprocess,butinsteadhelpslegaluserstocontrolandcommunicatethoseprocessesmoreeffectively.

HerearejustsomeoftheexamplesyoucanuseIBMStoredIQeDiscovery.

Youneedtofindallelectronicinformationaboutanupcomingpersonal-injurylawsuit.YoucanuseIBMStoredIQeDiscoverytocreateamatterforthesuit,andthencreateboxestocontainemailandreportsaboutthecase.Asalegaluser,youwanttoseethestatusofallcurrentlyactivematters.YoucanusetheMatterDashboardtovisualizethedifferentmatters'states.Asadataexpert,youknowthatyouneedtorespondtousersinatimelyfashion.UsingIBMStoredIQeDiscovery,peoplecanemailyoudirectlyfromtheapplicationaboutamatter'squestions.

ProactiveeDiscoveryconsistsofidentifyingandcatalogingdataortypesofdatathatmighteventuallyberesponsivetolegalmatters.Itcollectsandretainsthedataandthenproducesthatdatainawaythatmatchesacceptedorrequiredlegalpractices.

WithinIBMStoredIQeDiscovery,theuserisanon-technicaluserwhoneedstoobtaincertainpiecesofdatatocompletealegalprocess.TheIBMStoredIQeDiscoveryuserknowstheinformationorparametersforwhatkindsofdatatheywant,butdoesnotalwaysknowhowtoobtainthatdata.

BeforeyouuseIBMStoredIQeDiscovery,ensurethatprerequisitesaremet:

TheIBMStoredIQPlatformmustbedeployed,configured,andreadyforuse.IBMStoredIQeDiscoveryisdependentuponotherIBMStoredIQapplicationssuchasIBMStoredIQDataWorkbenchandIBMStoredIQAdministrator.

Parenttopic:IBMStoredIQinterfacecomponents

IBMUnstructuredData751, p. 11

Page 21: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

IBMStoredIQDataScriptThroughtheIBM®StoredIQDataScriptinterface,youcanmonitoreachofthestepsastheyarerun.Then,youviewanydefinedoutputs,suchasreports,infosets,orexportsthataregeneratedasaresult.ByrunningIBMStoredIQDataWorkbenchworkflows,theusercanreapplyprocessesthatwerereviewedandapprovedtoapplytoawidevarietyofdifferentdataproblems.

Parenttopic:IBMStoredIQinterfacecomponents

IBMUnstructuredData751, p. 12

Page 22: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

IBMStoredIQPolicyManagerIBM®StoredIQPolicyManagerenablespolicyexecutionatscale.

IBMStoredIQPolicyManagerallowsuserstorunmaturepoliciesandprocessesatscaleacrossawiderrangeofdata.Theuserscandefineandrunsystemwidepolicies,focusingontheexecutionoftheprocessratherthanunderstandingorreviewingaffecteddataobjects.Additionally,withIBMStoredIQPolicyManager'sreports,youcanrecordwhatactionswereconducted,whentheywereconducted,andwhatdatawasaffectedbythepolicy'sexecution.

Parenttopic:IBMStoredIQinterfacecomponents

IBMUnstructuredData751, p. 13

Page 23: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

NoticesThisinformationwasdevelopedforproductsandservicesofferedintheU.S.A.ThismaterialmaybeavailablefromIBMinotherlanguages.However,youmayberequiredtoownacopyoftheproductorproductversioninthatlanguageinordertoaccessit.

IBMmaynotoffertheproducts,services,orfeaturesdiscussedinthisdocumentinothercountries.ConsultyourlocalIBMrepresentativeforinformationontheproductsandservicescurrentlyavailableinyourarea.AnyreferencetoanIBMproduct,program,orserviceisnotintendedtostateorimplythatonlythatIBMproduct,program,orservicemaybeused.Anyfunctionallyequivalentproduct,program,orservicethatdoesnotinfringeanyIBMintellectualpropertyrightmaybeusedinstead.However,itistheuser'sresponsibilitytoevaluateandverifytheoperationofanynon-IBMproduct,program,orservice.

IBMmayhavepatentsorpendingpatentapplicationscoveringsubjectmatterdescribedinthisdocument.Thefurnishingofthisdocumentdoesnotgrantyouanylicensetothesepatents.Youcansendlicenseinquiries,inwriting,to:IBMDirectorofLicensingIBMCorporationNorthCastleDriveArmonk,NY10504-1785U.S.A.Forlicenseinquiriesregardingdouble-byte(DBCS)information,contacttheIBMIntellectualPropertyDepartmentinyourcountryorsendinquiries,inwriting,to:IntellectualPropertyLicensingLegalandIntellectualPropertyLawIBMJapanLtd.19-21,Nihonbashi-Hakozakicho,Chuo-kuTokyo103-8510,Japan

ThefollowingparagraphdoesnotapplytotheUnitedKingdomoranyothercountrywheresuchprovisionsareinconsistentwithlocallaw:INTERNATIONALBUSINESSMACHINESCORPORATIONPROVIDESTHISPUBLICATION"ASIS"WITHOUTWARRANTYOFANYKIND,EITHEREXPRESSORIMPLIED,INCLUDING,BUTNOTLIMITEDTO,THEIMPLIEDWARRANTIESOFNON-INFRINGEMENT,MERCHANTABILITYORFITNESSFORAPARTICULARPURPOSE.Somestatesdonotallowdisclaimerofexpressorimpliedwarrantiesincertaintransactions,therefore,thisstatementmaynotapplytoyou.

Thisinformationcouldincludetechnicalinaccuraciesortypographicalerrors.Changesareperiodicallymadetotheinformationherein;thesechangeswillbeincorporatedinneweditionsofthepublication.IBMmaymakeimprovementsand/orchangesintheproduct(s)and/ortheprogram(s)describedinthispublicationatanytimewithoutnotice.

Anyreferencesinthisinformationtonon-IBMWebsitesareprovidedforconvenienceonlyanddonotinanymannerserveasanendorsementofthoseWebsites.ThematerialsatthoseWebsitesarenotpartofthematerialsforthisIBMproductanduseofthoseWebsitesisatyourownrisk.

IBMmayuseordistributeanyoftheinformationyousupplyinanywayitbelievesappropriatewithoutincurringanyobligationtoyou.

Licenseesofthisprogramwhowishtohaveinformationaboutitforthepurposeofenabling:(i)theexchangeofinformationbetweenindependentlycreatedprogramsandotherprograms(includingthisone)and(ii)themutualuseoftheinformationwhichhasbeenexchanged,shouldcontact:IBMCorporationJ46A/G4555BaileyAvenueSanJose,CA95141-1003U.S.A.

IBMUnstructuredData751, p. 14

Page 24: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Suchinformationmaybeavailable,subjecttoappropriatetermsandconditions,includinginsomecases,paymentofafee.

ThelicensedprogramdescribedinthisdocumentandalllicensedmaterialavailableforitareprovidedbyIBMundertermsoftheIBMCustomerAgreement,IBMInternationalProgramLicenseAgreementoranyequivalentagreementbetweenus.

Anyperformancedatacontainedhereinwasdeterminedinacontrolledenvironment.Therefore,theresultsobtainedinotheroperatingenvironmentsmayvarysignificantly.Somemeasurementsmayhavebeenmadeondevelopment-levelsystemsandthereisnoguaranteethatthesemeasurementswillbethesameongenerallyavailablesystems.Furthermore,somemeasurementsmayhavebeenestimatedthroughextrapolation.Actualresultsmayvary.Usersofthisdocumentshouldverifytheapplicabledatafortheirspecificenvironment.

Informationconcerningnon-IBMproductswasobtainedfromthesuppliersofthoseproducts,theirpublishedannouncementsorotherpubliclyavailablesources.IBMhasnottestedthoseproductsandcannotconfirmtheaccuracyofperformance,compatibilityoranyotherclaimsrelatedtonon-IBMproducts.Questionsonthecapabilitiesofnon-IBMproductsshouldbeaddressedtothesuppliersofthoseproducts.

AllstatementsregardingIBM'sfuturedirectionorintentaresubjecttochangeorwithdrawalwithoutnotice,andrepresentgoalsandobjectivesonly.

Thisinformationcontainsexamplesofdataandreportsusedindailybusinessoperations.Toillustratethemascompletelyaspossible,theexamplesincludethenamesofindividuals,companies,brands,andproducts.Allofthesenamesarefictitiousandanysimilaritytothenamesandaddressesusedbyanactualbusinessenterpriseisentirelycoincidental.

COPYRIGHTLICENSE:

Thisinformationcontainssampleapplicationprogramsinsourcelanguage,whichillustrateprogrammingtechniquesonvariousoperatingplatforms.Youmaycopy,modify,anddistributethesesampleprogramsinanyformwithoutpaymenttoIBM,forthepurposesofdeveloping,using,marketingordistributingapplicationprogramsconformingtotheapplicationprogramminginterfacefortheoperatingplatformforwhichthesampleprogramsarewritten.Theseexampleshavenotbeenthoroughlytestedunderallconditions.IBM,therefore,cannotguaranteeorimplyreliability,serviceability,orfunctionoftheseprograms.Thesampleprogramsareprovided"ASIS",withoutwarrantyofanykind.IBMshallnotbeliableforanydamagesarisingoutofyouruseofthesampleprograms.

Eachcopyoranyportionofthesesampleprogramsoranyderivativework,mustincludeacopyrightnoticeasfollows:©(yourcompanyname)(year).PortionsofthiscodearederivedfromIBMCorp.SamplePrograms.©CopyrightIBMCorp.2004,2010.Allrightsreserved.

Ifyouareviewingthisinformationsoftcopy,thephotographsandcolorillustrationsmaynotappear.

PrivacypolicyconsiderationsTermsandconditionsforproductdocumentationPermissionsfortheuseofthesepublicationsaregrantedsubjecttothefollowingtermsandconditions.Trademarks

Parenttopic:OverviewoftheIBMStoredIQcomponents

IBMUnstructuredData751, p. 15

Page 25: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

PrivacypolicyconsiderationsIBMSoftwareproducts,includingsoftwareasaservicesolutions,(“SoftwareOfferings”)mayusecookiesorothertechnologiestocollectproductusageinformation,tohelpimprovetheenduserexperience,totailorinteractionswiththeenduserorforotherpurposes.InmanycasesnopersonallyidentifiableinformationiscollectedbytheSoftwareOfferings.SomeofourSoftwareOfferingscanhelpenableyoutocollectpersonallyidentifiableinformation.IfthisSoftwareOfferingusescookiestocollectpersonallyidentifiableinformation,specificinformationaboutthisoffering’suseofcookiesissetforthbelow.

[Dependingupontheconfigurationsdeployed,thisSoftwareOfferingmayuse[session][and][persistent]cookiesthatcollecteachuser’s[name,][username,][password,][profilename,][position,]or[otherpersonallyidentifiableinformation]forpurposesof[sessionmanagement,][authentication,][enhanceduserusability,][singlesign-onconfiguration][orotherusagetrackingorfunctionalpurposes.]Thesecookies[cannotbedisabled][canbedisabled,butdisablingthemwillalso[likely]eliminatethefunctionalitytheyenable].

IftheconfigurationsdeployedforthisSoftwareOfferingprovideyouascustomertheabilitytocollectpersonallyidentifiableinformationfromendusersviacookiesandothertechnologies,youshouldseekyourownlegaladviceaboutanylawsapplicabletosuchdatacollection,includinganyrequirementsfornoticeandconsent.

Formoreinformationabouttheuseofvarioustechnologies,includingcookies,forthesepurposes,SeeIBM’sPrivacyPolicyathttp://www.ibm.com/privacyandIBM’sOnlinePrivacyStatementathttp://www.ibm.com/privacy/detailsthesectionentitled“Cookies,WebBeaconsandOtherTechnologies”andthe“IBMSoftwareProductsandSoftware-as-a-ServicePrivacyStatement”athttp://www.ibm.com/software/info/product-privacy.

Parenttopic:Notices

IBMUnstructuredData751, p. 16

Page 26: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

TermsandconditionsforproductdocumentationPermissionsfortheuseofthesepublicationsaregrantedsubjecttothefollowingtermsandconditions.

Applicability

ThesetermsandconditionsareinadditiontoanytermsofusefortheIBMwebsite.

Personaluse

Youmayreproducethesepublicationsforyourpersonal,noncommercialuseprovidedthatallproprietarynoticesarepreserved.Youmaynotdistribute,displayormakederivativeworkofthesepublications,oranyportionthereof,withouttheexpressconsentofIBM.

Commercialuse

Youmayreproduce,distributeanddisplaythesepublicationssolelywithinyourenterpriseprovidedthatallproprietarynoticesarepreserved.Youmaynotmakederivativeworksofthesepublications,orreproduce,distributeordisplaythesepublicationsoranyportionthereofoutsideyourenterprise,withouttheexpressconsentofIBM.

Rights

Exceptasexpresslygrantedinthispermission,nootherpermissions,licensesorrightsaregranted,eitherexpressorimplied,tothepublicationsoranyinformation,data,softwareorotherintellectualpropertycontainedtherein.

IBMreservestherighttowithdrawthepermissionsgrantedhereinwhenever,initsdiscretion,theuseofthepublicationsisdetrimentaltoitsinterestor,asdeterminedbyIBM,theaboveinstructionsarenotbeingproperlyfollowed.

Youmaynotdownload,exportorre-exportthisinformationexceptinfullcompliancewithallapplicablelawsandregulations,includingallUnitedStatesexportlawsandregulations.

IBMMAKESNOGUARANTEEABOUTTHECONTENTOFTHESEPUBLICATIONS.THEPUBLICATIONSAREPROVIDED"AS-IS"ANDWITHOUTWARRANTYOFANYKIND,EITHEREXPRESSEDORIMPLIED,INCLUDINGBUTNOTLIMITEDTOIMPLIEDWARRANTIESOFMERCHANTABILITY,NON-INFRINGEMENT,ANDFITNESSFORAPARTICULARPURPOSE.

Parenttopic:Notices

IBMUnstructuredData751, p. 17

Page 27: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

TrademarksIBM,theIBMlogo,andibm.comaretrademarksorregisteredtrademarksofInternationalBusinessMachinesCorp.,registeredinmanyjurisdictionsworldwide.OtherproductandservicenamesmightbetrademarksofIBMorothercompanies.AcurrentlistofIBMtrademarksisavailableontheWebat"Copyrightandtrademarkinformation"athttp://www.ibm.com/legal/copytrade.shtml

Adobe,theAdobelogo,PostScript,andthePostScriptlogoareeitherregisteredtrademarksortrademarksofAdobeSystemsIncorporatedintheUnitedStates,and/orothercountries.

LinuxisaregisteredtrademarkofLinusTorvaldsintheUnitedStates,othercountries,orboth.

Microsoft,Windows,WindowsNT,andtheWindowslogoaretrademarksofMicrosoftCorporationintheUnitedStates,othercountries,orboth.

JavaandallJava-basedtrademarksandlogosaretrademarksorregisteredtrademarksofOracleand/oritsaffiliates.

UNIXisaregisteredtrademarkofTheOpenGroupintheUnitedStatesandothercountries.

Othercompany,product,andservicenamesmaybetrademarksorservicemarksofothers.

Parenttopic:Notices

IBMUnstructuredData751, p. 18

Page 28: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DeployingandconfiguringIBMStoredIQPlatformBeforeyoudeployandconfigureIBM®StoredIQPlatform,ensurethatyoumeetalldeploymentprerequisitesandrequirementsthataredocumentedintheDeploymentpreparationchapter.YoumustalsomeetallhardwareandsoftwarerequirementsinIBMStoredIQPlatformOverviewGuide.

IBMStoredIQcomponentsThefollowingsectionsdescribethreecomponentsoftheIBMStoredIQsolutionandtheinterfacesthatIBMStoredIQproductprovidestousetheservicesoftheIBMStoredIQPlatform.DeploymentpreparationTopreventanydeploymentproblems,conductthefollowingplanningactivitiesthatareappropriateforyourenvironment.DeploymentofIBMStoredIQPlatformThefollowingsectionsdescribehowtodeploythevirtualappliances.InstallationofIBMStoredIQPlatformAftertheOVFdeployment,proceedtoinstalltheIBMStoredIQPlatform.ConfigurationofIBMStoredIQPlatformAfteryoudeployvirtualappliances,youmustconfigureIBMStoredIQPlatformbeforeyoucanfulfilltheproductinstallationprocess.CreatingatemplatefromtheIBMStoredIQOVAOVAscanbemodifiedtofituniquedeploymentscenarios.EditingtheOVFfileIfyouneedtoscaledownthesizeoftheindexdriveonthedataservers,youcanedittheOVFfile.UpgradesYoucanobtaintheupgradeISOfromtheIBMFixCentral.Upgradesconsistofupgradingthegatewayanddataserverfirstandthentheapplicationstack.CustomizablereportsReportingisakeystepwithinthedata-managementprocessasitvalidatesthatprocesseswerecompletedcorrectlywithinIBMStoredIQ.

IBMUnstructuredData751, p. 19

Page 29: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

IBMStoredIQcomponentsThefollowingsectionsdescribethreecomponentsoftheIBM®StoredIQsolutionandtheinterfacesthatIBMStoredIQproductprovidestousetheservicesoftheIBMStoredIQPlatform.

ComponentsoftheIBMStoredIQsolutionThethreecomponentsoftheIBMStoredIQsolutionaretheGateway,DataServers,andApplicationStack(AppStack).IBMStoredIQproductsTheIBMStoredIQproductsincludeIBMStoredIQAdministrator,IBMStoredIQDataWorkbench,IBMStoredIQeDiscovery,IBMStoredIQDataScript,IBMStoredIQPolicyManager,andIBMDesktopDataCollector.

IBMUnstructuredData751, p. 20

Page 30: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ComponentsoftheIBMStoredIQsolutionThethreecomponentsoftheIBM®StoredIQsolutionaretheGateway,DataServers,andApplicationStack(AppStack).

TheGatewayThegatewaycommunicatesbetweenthedataserversandtheapplicationstack.Theapplicationstackpollsthegatewayforinformationaboutthedataonthedataservers.Thedataserverspushtheinformationtothegateway.

DataServersIBMStoredIQPlatformDataServerhelpsunderstandthedatalandscapeoftheenterprise.Itobtainsthedatafromsupporteddatasourcesandindexesit.Byindexingthisdata,yougaininformationaboutunstructureddatasuchasfilesize,filedatatypes,andfileowners.Thedataserverspushtheinformationaboutvolumesandindexestothegatewaysoitcanbecommunicatedtotheapplicationstack.Multipledataserversfeedintoasinglegateway.Inadditiontoanadministratoruserinterface,administratorscandeploytheIBMDesktopDataCollectorandindexdesktopsfromthedataserver.

ApplicationstackTheapplicationstackprovidestheuserinterfacefortheIBMStoredIQAdministrator,IBMStoredIQDataWorkbench,IBMStoredIQeDiscovery,IBMStoredIQDataScript,andtheIBMStoredIQPolicyManagerproducts.

Parenttopic:IBMStoredIQcomponents

IBMUnstructuredData751, p. 21

Page 31: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

IBMStoredIQproductsTheIBM®StoredIQproductsincludeIBMStoredIQAdministrator,IBMStoredIQDataWorkbench,IBMStoredIQeDiscovery,IBMStoredIQDataScript,IBMStoredIQPolicyManager,andIBMDesktopDataCollector.

IBMStoredIQAdministratorIBMStoredIQAdministratormonitorsandmanagesthedistributedinfrastructureataclientsite.IBMStoredIQAdministratorsitsbetweentheIBMStoredIQPlatforminterfaceandtheapplicationsandfacilitatesthetransferandcommunicationofinformation.IBMStoredIQAdministratorunderstandsandmanagesIBMStoredIQPlatformconceptssuchasvolumes,indexes,harvests,andconfigurations.Atthesametime,itmanagestheapplicationconcernssuchasinfosetlifecycleandcreation,dataserverandvolumeconfiguration,andactionandtargetsetmanagement.Tothisend,itisdividedintotwosections,thatis,platformandapplicationsothattheadministratorsknowwheretoaccomplishatask.

IBMStoredIQDataWorkbenchIBMStoredIQDataWorkbenchenablesvisualizingtheindexeddata.Youcanidentifypotentialred-flagissuestoknowhowmuchandwhattypesofdatayouhaveondifferenttypesofservers.Italertspeopleaboutpotentiallyinterestingorusefuldata.

IBMStoredIQeDiscoveryIBMStoredIQeDiscoveryisintegraltotheeDiscoveryprocess.Ithelpsdiscover,identify,refine,preserve,andcollectdatathatisrelevanttolegalmatters.WithIBMStoredIQeDiscovery,youcanconductdiscoveryworkmoreefficientlyandcapturetheappropriatedata.

IBMStoredIQDataScriptIBMStoredIQDataScriptenablesautomatedexecutionwithinIBMStoredIQPlatform.Itscripts,automates,andmonitorsprocessesthatotherwisenormallyareamanualprocessthatisrunwithinIBMStoredIQDataWorkbench.IBMDataScriptfocusesonrepeatable,understood,andapprovedprocessesforthepurposesofcullingandrefiningdatainanapprovedmanner.

IBMStoredIQPolicyManagerIBMStoredIQPolicyManageractsondatainanautomaticfashionatscale,runningpoliciesthataffectdataobjectswithoutrequiringreview.

IBMDesktopDataCollectorTheIBMDesktopDataCollectordeploysfromtheIBMStoredIQDataServerAdministratorinterface.Itindexesdesktopsasvolumes.ThevolumesappearintheDataServerAdministratorinterface,theIBMStoredIQDataWorkbench,wherethedatacanbeanalyzedandactedupon,andtheIBMStoredIQAdministratorapplication.

IBMStoredIQPlatformusesanon-invasivedeployment,specifically:

Lightweightclientdeploymentwithnobrowserplug-insandnoclient-sideUIinstallations.Allmajorbrowsers,suchasInternetExplorerandFirefox,aresupportednatively.One(common)indexthatissharedacrossallusecases.Thisindexsupportsawidevarietyofdatasourcesandisusedbyapplicationdashboardsformanyusecases.Noagentsareplacedondatasources.ThenativeAPI/protocolisusedwheneveritispossible.Third-partyorcustomconnectorsareusedonlywhennecessary.Note:Agentsareusedfordesktopcollection.

Parenttopic:IBMStoredIQcomponents

IBMUnstructuredData751, p. 22

Page 32: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DeploymentpreparationTopreventanydeploymentproblems,conductthefollowingplanningactivitiesthatareappropriateforyourenvironment.

DeploymentplanningWhenyouplanadeploymentofIBM®StoredIQPlatform,evaluateseveralinfrastructureconsiderations.Stack-provisioningprerequisitesBeforeadeployment,verifythatyoumeettheseprerequisites.

IBMUnstructuredData751, p. 23

Page 33: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DeploymentplanningWhenyouplanadeploymentofIBM®StoredIQPlatform,evaluateseveralinfrastructureconsiderations.

OpenVirtualAppliance(OVA)configurationrequirementsIBMStoredIQPlatformisdeployedasvirtualappliancesandcurrentlyonlysupportedinVMwareESX(i)5.xorgreaterenvironments.YoumusthaveavirtualinfrastructurethatmeetstheIBMStoredIQPlatformhardwarerequirements.NetworkandportrequirementsDatasourcesandtypescandrasticallyimpactthescaleandscopeofwhatneedstobedeployed.Thecomplexityofthesourcedirectlyaffectsthenumberofdataserverstobedeployed,forexample,exchangeversussimpletextdocumentsinaCIFSlocation.EnvironmentsizingguidelinesTosizeanenvironmentprecisely,youmustunderstandthefactorssuchasharvestfrequency,complexityofthesource,andusecasescenariosthatdriveapplicationuseandactionexecution.

Parenttopic:Deploymentpreparation

IBMUnstructuredData751, p. 24

Page 34: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

OpenVirtualAppliance(OVA)configurationrequirementsIBM®StoredIQPlatformisdeployedasvirtualappliancesandcurrentlyonlysupportedinVMwareESX(i)5.xorgreaterenvironments.YoumusthaveavirtualinfrastructurethatmeetstheIBMStoredIQPlatformhardwarerequirements.

Gatewayserversize

vCPU:1Memory:8GBStorage:100GB

Applicationstacksize

vCPU:1Memory:4GBStorage:20GB

DataServersize

vCPU:4Note:EventhoughincreasingthenumberofvCPUsincreasesperformance,theactualbenefitsdependonwhetherthespecifichostisoversubscribedornot.Memory:16GBNote:Whiletheminimumvalueworksunderlight-loadcondition,astheloadincreases,theDataServerquicklystartsconsumingswapspace.Forhighloadsituations,increasingRAMbeyond16GBcanbenefitperformance.Monitoringswapusagecanprovideinsight.Storage:

PrimaryDisk(vmdisk1,SCSI0:0):Defaultis190GBNote:ThisvirtualdiskhasanassociatedVMDKthatcontainstheIBMoperatingcode.Donotchangeitssize.Note:Ifyoudeletetheprimarydisk,youdeletetheoperatingsystem,andtheIBMsoftware;thevirtualmachinemightneedtobescrapped.DataDisk(vmdisk2,SCSI0:1):Defaultis1.9TBNote:Thisvirtualdiskcanberesizedaccordingtoexpectationsontheamountofharvestdatatobestored.Forpurposesofestimation,theindexstoragerequirementformetadataisabout30GBperTBofmanagedsourcedata.Full-textindexingrequiresanextra170GBperTB.Thedefaultdatadisksizeisthereforetargetedformanaging10TBofsourceinformation.SwapDisk(vmdisk3,SCSI0:2):Defaultis40GBNote:Whenunderload,theDataServercanusemanyRAM;therefore,havingampleswapspaceisprudent.TheminimumswapsizeisequaltotheamountofRAMconfiguredforthevirtualmachine.Forbestperformanceunderload,placethisdiskonthehighestspeeddatastoreavailabletothehost.

Thegeneralsizelimitsforadataserverare150millionobjectsor500definedvolumes,whicheverlimitisreachedfirst.Assuminganaverageobjectsizeof200KBequalstoabout30TBofmanagedstorageacross30volumesof5millionobjectseach,theindexstoragerequirementformetadataon~30TBofstoragethatcontainsuncompressedgeneralofficedocumentsis~330GB(11GBperTB).Add100GBperTBofmanagedstorageforfull-textorsnippetindex.Forexample,tosupport30TBofstoragethatisindexedformetadata,youneed8TBindexedforfull-textsearchandextractedtext(snippetcache)of8TBforauto-classification.Atotalof1.9TBofstorageisrequired(metadata:330GB,full-text:800GB,snippetcache:800GB).

DataServerperformanceisimpactedbytheIOPSavailablefromthestoragesubsystem.ForeachDataServerundermaximumworkload,atleast650IOPSgenerallydeliversacceptableperformance.Inthesituationswherethereisahighloadonthesystem,the

IBMUnstructuredData751, p. 25

Page 35: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

IOPSthatisusedcanreachupto7000withmainwriteoperations.

Parenttopic:Deploymentplanning

IBMUnstructuredData751, p. 26

Page 36: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

NetworkandportrequirementsDatasourcesandtypescandrasticallyimpactthescaleandscopeofwhatneedstobedeployed.Thecomplexityofthesourcedirectlyaffectsthenumberofdataserverstobedeployed,forexample,exchangeversussimpletextdocumentsinaCIFSlocation.

Youmustenablenetworkconnectivityfromthefollowinglocations:

ThedataserverIPaddresstothegatewayIPaddressonport11103.ThegatewayIPaddresstoandfromtheappstackIPaddressonports8765and5432.Ports80,443,and22fromtheadministrativeuser'sworkstation(placefromwhichtheadministratoriscompletingworkwithIBM®StoredIQAdministrator)totheapplicationstackanddataserverIPaddresses.Port22fromtheadministrativeworkstationtotheGatewayIPaddress.

Parenttopic:Deploymentplanning

IBMUnstructuredData751, p. 27

Page 37: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

EnvironmentsizingguidelinesTosizeanenvironmentprecisely,youmustunderstandthefactorssuchasharvestfrequency,complexityofthesource,andusecasescenariosthatdriveapplicationuseandactionexecution.

ThegeneraldesignguidelinesfortheIBM®StoredIQrelease7.xisasfollows:

Onedataserverper30TBsoffileshares.Variesdependonnumberofvolumes,objectspervolume,andobjecttypesOnegatewayper50dataservers.Oneapplicationserver.NFSisslightlyfasterthanCIFSformetadataonly,butassumeCIFS/NFSevenforthisexercise.Full-contentprocessingoffile(Forexample,.ZIP,.RAR,.GZ)andemailarchive(.PST,.NSF,.EMX)processingareslowerasitemsmustbeextractedfromthearchives.Ifthereisasignificantnumberofthesefilesinthefilesystemandtheyarenotexcludedfromcontentprocessing,thefull-contentprocessingratecanbetoohigh.Untilyouhaveaninitialindexofthefilesystem,youdonotknowhowtoweighfull-contentprocessingofarchives.Anobject/timemetricisappropriateformetadataonlyNOTcomputingahash,membershipintheNationalInstituteofStandardsandTechnology(NIST)orenumeratingobjectsthatarecontainedinarchives.Convertingittoabytes/timemetricisafunctionoftheaverageobjectsizeandmightvarytremendously.Anaverageobjectsizeof250KBwasusedforthemetricthatisprovidedearlier.Abytes/timemetricisappropriateformetadata-onlycomputingahashandfull-contentprocessing.Theobjectpersecondratecanvarytremendouslydependingontheobjecttypeandsizesencountered.Forexample,processinganemailorfilearchiveismuchmoreexpensivethanaPDFdocument.Metadata-onlynotcomputingahash,membershipintheNISTlist,orenumeratingobjectsthatarecontainedinarchivesisrequestingonlythefile-attributeinformationfromtheNAS.Individualfilesarenotopenedandread.Theprocessingrateishigh,butthatdoesnottranslateintoalargeamountofdatathattraversesanetworkbetweentheNASanddataserver.Thebytes/timeratedoesnottranslateintobytesservedbytheNASandsentoverthenetwork.Metadata-onlycomputingahash,membershipintheNISTlist,orenumeratingobjectsthatarecontainedinarchivesopensandreadsthecontentsofeachfile.ThecontentofallrequestedfilestraversesthenetworkbetweentheNASanddataserver.ThemaximumloadthatthedataservercanplaceonaNASismetadata-onlyprocessing.Itrequiresallfilecontenttobereadtocomputeahashorenumerateobjectsthatarecontainedinarchives.Thebytes/timeratetranslatesintobytesservedupbytheNASandnetworktrafficthatmustbeconsidered.Full-contentprocessingopensandreadsthecontentsofeachfiletoextractalltext.ThecontentofallrequestedfilestraversesthenetworkbetweentheNASanddataserver.Theprocessingtimetoenumeratearchives,extracttext,indexwords,andextractentitiesonthedataserverreducestheratethatdataisrequestedfromaNAScomparedtometadata-onlywithfullhash.Thebytes/timeratetranslatesintobytesservedupbytheNASandnetworktrafficthatmustbeconsidered.Theinterrogatorprocesscountonthedataserverfor"metadataonlynotreadingallcontentindexing"canbesettofourforoptimalperformance.Theinterrogatorprocesscountforallotherprocessingthatinvolvesreadingallcontentisassumedtobetwoperdataserver.Theinterrogatorcountcanbeviewedasthenumberofclientconnectionsthataremadetoadatasourceactivelyrequestingdata.Itisimportantforcapacityplanningforthedatasource.Thedataserversareassumedtobe"networkclose"totheNASdatasources.Networklatencyunder10mswithatleast1000Mbpsbandwidthisassumed(connectedthroughlocalareanetwork).Thedataserversneedalowlatencyhigh-bandwidthconnectiontoaNASdatasourceforacceptableindexingperformance.Thegatewayandapplicationstackcanbelocatedremotelyfromthedataservers.

IBMUnstructuredData751, p. 28

Page 38: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Networkconnectionswithlatencygreaterthan10msandbandwidthofatleast2+Mbpsareacceptable.

VMwarevSphererequirements

VMwarevSpherev5.xorgreater.VMwarevirtualmachineversion8.0orlater.VMwarelicensetoenabletherequiredprocessorcoresandmemoryforthevirtualmachine.

Parenttopic:Deploymentplanning

IBMUnstructuredData751, p. 29

Page 39: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Stack-provisioningprerequisitesBeforeadeployment,verifythatyoumeettheseprerequisites.

Atleastonephysicalserverwithsufficientprocessor,RAM,andharddiskconfigurationfortheplannedmanagementproject.VMwareESXorESXionCD/DVDorUSBdrive.IPaddresses,cables,andphysicalswitchportsforatleasttheESXi/ESXinterface,onedataserver,onegatewayserver,andoneapplicationstack.Networkconnectivitythatisenabledfromthefollowinglocations:

ThedataserverIPaddresstothegatewayIPaddressonport11103ThegatewayIPaddresstoandfromtheapplicationstackIPaddressonport8765Ports80,443,and22fromtheadministrativeworkstationtotheapplicationstackanddataserverIPaddressesPort22fromtheadministrativeworkstationtothegatewayIPaddress.

NetworkconnectivitythatisenabledfromthedataserverIPaddresstoanydatasourcestobeharvestedandmanaged.Amanagementstationcomputerornotebookfromwheretheload-managementworkisdone.

Parenttopic:Deploymentpreparation

IBMUnstructuredData751, p. 30

Page 40: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DeploymentofIBM®StoredIQPlatformThefollowingsectionsdescribehowtodeploythevirtualappliances.

OpenVirtualizationFormat(OVF)AnOVFisafileformatthatallowsfortheexchangeofvirtualappliancesacrossproductsandplatforms.DeployingthevirtualappliancesUsevSphereClienttodeploythevirtualappliancestoanESXserver.ThreeOVAsneedtobedeployedinthisorder:thegateway,dataserver,andapplicationstack.

IBMUnstructuredData751, p. 31

Page 41: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

OpenVirtualizationFormat(OVF)AnOVFisafileformatthatallowsfortheexchangeofvirtualappliancesacrossproductsandplatforms.

TheOVFformatofferstheseadvantages:

OVFfilesarecompressed,allowingforfasterdownloads.ThevSphereClientvalidatesanOVFfilebeforeitimportsitandensuresthatitiscompatiblewiththeintendeddestinationserver.Ifthevirtualapplianceisincompatiblewiththeselectedhost,itcannotbeimported,andanerrormessageappears.AnOVFcanencapsulatemultitieredapplicationsandmorethanonevirtualmachine.

ThebasicdifferencesbetweenOVFsandOVAsareasfollows:

AnOVFisacollectionofitemsinasinglefolder.Mostcommonly,itisadescriptionfile(.ovf),amanifestfile(.mf),andvirtualmachinestatefiles(*.vhdor*.vmdk).AnOVAisasinglefile.TheOVAistheOVFfoldercontentsthatareallcompressedintoasinglefile.TheOVAisusedwhenyouwanttotakeanOVFandshareit,orgiveitasadownload.TheOVAneedstobeopenedintotheOVFbeforeitcanbeused,althoughitisnotnecessarywhenyouuseVMware.Thisstepisautomaticallyconductedduringimport.BothOVFandOVAfilescanbedirectlyimportedintovCenterandvSphere.

Parenttopic:DeploymentofIBMStoredIQPlatform

IBMUnstructuredData751, p. 32

Page 42: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DeployingthevirtualappliancesUsevSphereClienttodeploythevirtualappliancestoanESXserver.ThreeOVAsneedtobedeployedinthisorder:thegateway,dataserver,andapplicationstack.

BeforeyoubeginEnsurethatallprerequisitesforthedeploymentaremetbeforeyoustartthistask.

AboutthistaskThenumberofdataserverOVAsdeployeddependsuponthenumberofdataserversneeded.EachdataserverrequiresaseparateOVAdeployment.

Procedure1. ConnecttoESXserverorvCenterserver.2. FromtheFilemenu,selectDeployOVFTemplate.3. FollowtheDeployOVFTemplatewizard.4. OntheSourcepage,completethesesteps:

a. SelectFile>Deploy.b. BrowseandselecttheappropriateOVA,andthenclickNext.

5. ReviewtheOVFTemplateDetails.Note:Thestoragerequirementsarecriticalforlaterselectingadatastoreinthedeployment.

6. ClickNext.7. OntheNameandLocationpage,namethedeployedtemplateorusethedefaultname.8. OntheHost/Clusterpage,selectthehostandclusterwherethedeployedOVFtemplate

runs,andthenclickNext.9. OntheResourcePoolpage,selecttheresourcepoolwherethedeployedOVFtemplate

runs,andthenclickNext.10. OntheStoragepage,selectadatastoreonwhichtostorethedeployedOVFtemplate

files,andthenclickNext.11. OntheDiskFormatpage,selectthediskformattobedeployed.

Note:ThoughThinProvisionsavesdiskspace,itcannegativelyaffectperformance.Ifpossible,selectThickProvisionLazyZeroed.

12. ClickNext.13. ForNetworkMapping,mapthenetworktotheappropriatenetworkinthelist,andthen

clickNext.14. OntheReadytoCompletepage,reviewthedeploymentsettingsandthenclickFinish.

Parenttopic:DeploymentofIBMStoredIQPlatform

IBMUnstructuredData751, p. 33

Page 43: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

InstallationofIBMStoredIQPlatformAftertheOVFdeployment,proceedtoinstalltheIBM®StoredIQPlatform.

Note:YoucaninstallIBMDesktopDataCollectoronlyafteryoufinishconfiguringthedataservers.ForinformationaboutinstallationofIBMDesktopDataCollector,seeInstallingIBMDesktopDataCollector

InstallingthegatewayanddataserversToinstallthegatewayanddataservers,youmustturnonthevirtualmachinefirst.

IBMUnstructuredData751, p. 34

Page 44: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

InstallingthegatewayanddataserversToinstallthegatewayanddataservers,youmustturnonthevirtualmachinefirst.

Procedure1. StarttheconsoleforthevirtualmachineinvCenter.2. SelectIAgreetoaccepttheCENTOSlicenseagreementandthenpressEnter.3. GotoIAgreetoaccepttheIBMlicenseagreement.4. FromtheCorporateNetworkConfigurationscreen,selecteitherStaticorObtainIPviaDCHP.

Toconfigurethestaticaddress,a. GatherthisinformationtocompletethestaticIPconfigurationforthesystem:Hostname,PublicNetworkIP,Netmask,Gateway,andPrimaryDNSHost.

b. GototheHostnamefieldandenterafullyqualifiedhostname.PressEnter.c. EnteranIPv4addressinthePublicIPboxandpressEnter.d. EntertheNetmaskfortheassignedIPaddressandpressEnter.e. EntertheIPaddressofthedefaultgatewayfortheIPsubnetandpressEnter.f. EntertheIPaddressforadomainnameserverandpressEnter.

ToobtainIPthroughDCHP,a. GatherthehostnameinformationtocompletetheDCHPIPconfigurationforthesystem.

b. SelectObtainIPviaDHCP.c. SelectHostnameandenterahostname.

5. Thechangepasswordpromptappears.Enterthenewpasswordtwice.TheinstallationoftheIBM®StoredIQoperatingsystemstarts.

6. Onthegatewayonly,apromptappearsaskingfortheappstack'sIPaddress.EntertheIPaddressoftheappstack.Ifyoudonotknoworareuncertainregardingtheappstack'sIPaddress,enter127.0.0.1.

Parenttopic:InstallationofIBMStoredIQPlatform

IBMUnstructuredData751, p. 35

Page 45: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ConfigurationofIBMStoredIQPlatformAfteryoudeployvirtualappliances,youmustconfigureIBM®StoredIQPlatformbeforeyoucanfulfilltheproductinstallationprocess.

ConfiguringthegatewayUsetheSSHtooltoconfigurethegateway.ConfiguringIBMStoredIQPlatformdataserverUsetheSSHtooltologontothedataserverasroot.ConfiguringtheapplicationstackFollowthesestepstoconfiguretheapplicationstack.InstallingIBMDesktopDataCollectorIBMDesktopDataCollectordeploysfromtheIBMDataServerAdministratorinterface.Youcannotinstallituntilyoufinishconfiguringthedataserverandbringituprunning.

IBMUnstructuredData751, p. 36

Page 46: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ConfiguringthegatewayUsetheSSHtooltoconfigurethegateway.

Procedure1. UsetheSSHtooltologontothegatewayserverasroot.2. IfyoudidnotenterthecorrectappstackIPaddresswhenyoudeploytheOVA,runthe

/usr/bin/set-appstack-ip.shscriptandthenentertheappstackIPaddresswhenprompted.Note:Thisscriptaddsanentryintothepg_hba.conffile,allowingtrustedaccesstothegatewaydatabasefromtheAppStackIP.Withoutthisaccess,reportscannotrunfromtheappstack.ThisscriptmustberunwhenevertheappstackIPaddresshappenstochange.

Parenttopic:ConfigurationofIBMStoredIQPlatform

IBMUnstructuredData751, p. 37

Page 47: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ConfiguringIBMStoredIQPlatformdataserverUsetheSSHtooltologontothedataserverasroot.

AboutthistaskYoumustcompletethistaskforeverydataserver.

Procedure1. Runservicedeepfilerrestart.2. Enterhttps://<IPofdataserver>inthebrowserandlogintoeachdataserverwithemail

adminandpasswordadmin.3. GotoAdministration>Configuration>DAGatewaysettings.4. EntertheIPofthegatewayinthehostfield.5. Enterthenameofthedataserverinthenodenamefield.6. Restartservicesineitherofthefollowingways:

LoginasrootwithPuTTYandthentypeservicedeepfilerrestart.Gotothedataserverdashboard,clicktheAboutAppliancelink,andthenclickRestartServices.

Parenttopic:ConfigurationofIBMStoredIQPlatform

IBMUnstructuredData751, p. 38

Page 48: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ConfiguringtheapplicationstackFollowthesestepstoconfiguretheapplicationstack.

BeforeyoubeginEnsurethattheapplicationstackispoweredon.StartthevCenterconsoleinterfacefortheapplicationstack.

AboutthistaskTherearetwousagemodesfortheconfigurationtools.TheyareBootstrapmodeandStandalonemode.

IntheBootstrapmode,aftertheinitialbootofanapplicationstack,aseriesofscreensappear.

Procedure1. AccepttheCENTOSandIBMlicenseagreements.PressEnter.Thechangepassword

promptappears.2. EnterthenewpasswordtwiceandpressEnter.Installationoftheapplicationinterface

starts.3. Whentheinstallationfinishes,theusernameandpasswordpromptappears.4. Entertherootusernameandpasswordthatyoupreviouslychanged.Thefollowingmenu

optionsarepresented:NetworkConfigurationAppstackConfigurationCertificateConfiguration

IntheStandalonemode,theapplicationstacktoolscanbeusedatanytimetomodifytheapplicationstackconfiguration.

Table1.ApplicationstacktoolsintheStandalonemode

Tool BinaryNetworkConfiguration /siq/bin/netcfgAppstackConfiguration /siq/bin/appstackcfgCertificateConfiguration /siq/bin/certcfg

NetworkConfigurationUsethistooltoconfiguretheapplicationstacknetwork.AppstackConfigurationUsethistooltoconfigurethegeneralapplicationstacksettings,includingtheapplicationstack'sStoredIQgateway,hostnamethatisusedbymanyapplications,andtheSMTPserver.CertificateConfigurationUsethistooltogenerateacertificate.Youmustcompleteallfourfollowingstepstoensureasuccessfulconfiguration.

Parenttopic:ConfigurationofIBMStoredIQPlatform

IBMUnstructuredData751, p. 39

Page 49: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

NetworkConfigurationUsethistooltoconfiguretheapplicationstacknetwork.

Table1.StaticIPSetting Notes

Hostname IPaddress Netmask Gateway PrimaryDNShost Restartnetworkservices Restartnetworkservicessettingsaresaved.

Table2.ObtainIPthroughDHCPSetting Notes

Hostname PrimaryDNShost Restartnetworkservices Restartsnetworkservicestoapplychanges.

Parenttopic:Configuringtheapplicationstack

IBMUnstructuredData751, p. 40

Page 50: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

AppstackConfigurationUsethistooltoconfigurethegeneralapplicationstacksettings,includingtheapplicationstack'sStoredIQgateway,hostnamethatisusedbymanyapplications,andtheSMTPserver.

Table1.AppstackConfigurationSetting Notes

Hostname ThehostnameforgeneratedURLsStoredIQGateway ThehostorIPoftheStoredIQGatewayserverSMTPServer MailserverhostorIPaddressSMTPPort Defaultsto25SMTPUser Ifsupportedbymailserver,loginusernameSMTPPassword Ifsupportedbymailserver,loginpasswordEnableTLS Ifsupportedbymailserver,enablesTLSencryptionRestartservices RestartsAppstackservicestoapplychanges

Parenttopic:Configuringtheapplicationstack

IBMUnstructuredData751, p. 41

Page 51: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

CertificateConfigurationUsethistooltogenerateacertificate.Youmustcompleteallfourfollowingstepstoensureasuccessfulconfiguration.

Note:Configuringacertificateisoptional.Toskipcertificateconfiguration,selectFinish.

Step1:Creatingself-signedrootcertificateGenerateaself-signedrootcertificate.Theresultingcertificatecanbeusedasacertificateauthority(CA).

Table1.Creatingself-signedrootcertificateSetting Notes

CommonName* Thenameofthecertificate(Required).EmailAddress* Country(two-letter)*

AnacceptableentryisanISO-3166-1alpha-2code.Alistingisavailablehere.

State/Province* City* Organization* Department* Keylength Thelengthofthekeytobecreated.Defaultis2048.Daystoexpire* Thedaysbeforethecertificateexpiration.Defaultis3650.Rootkeylocation* Thelocationofthekey.Oneiscreatediflocationdoesnotexist.Rootcertificatelocation Theoutputlocationoftherootcertificate.

Note:*meansthatthesettingisrequired.Step2:Creatingcertificatesigningrequest

Generateacertificatesigningrequest(CSR)tobesignedbyacertificateauthority.TheprocesscreatesakeyorusesaprovidedkeyandgeneratetheCSRfromit.Note:CommonnameinStep2mustbedifferentfromthecommonnameofStep1.

Table2.CreatingcertificatesigningrequestSetting Notes

CommonName* Thehostnameoftheappstack.ItmustmatchthedomainoftheURLthatyouuse.

EmailAddress*

Country(two-letter)* AnacceptableentryisanISO-3166-1alpha-2code.Alistingisavailablehere.

State/Province* City* Organization* Department* Keylength Thelengthofthekeytobecreated.Defaultis2048.

Keylocation* Thelocationofthekey.Oneiscreatedifthelocationdoesnotexist.

Certificaterequestlocation*

TheoutputlocationoftheCSR.

Note:*meansthatsettingisrequired.Step3:Signingrequestwithrootcertificate

Signaprovidedcertificate-signingrequestwithacertificateauthorityeligiblerootcertificate.

Table3.SigningrequestwithrootcertificateSetting Notes

Daystoexpire*Thedaysbeforecertificateexpiration.Defaultis3650.

IBMUnstructuredData751, p. 42

Page 52: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Certificaterequestlocation* ThelocationoftheCSRtosign.Certificatelocation* Theoutputlocationofthesignedcertificate.Rootkeylocation* Thelocationoftherootkey.Rootcertificatelocation* Thelocationoftherootcertificate.Note:*meansthatsettingisrequired.

Step4:UpdatingAppstackHTTPScertificateUpdatetheapplicationstacktousetheprovidedcertificateandkeyforHTTPSaccess.

Table4.UpdatingAppstackHTTPScertificateSetting Notes

Keylocation* Thelocationofthekey.Certificatelocation* Thelocationofthecertificate.Note:*meansthatsettingisrequired.

Parenttopic:Configuringtheapplicationstack

IBMUnstructuredData751, p. 43

Page 53: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

InstallingIBMDesktopDataCollectorIBM®DesktopDataCollectordeploysfromtheIBMDataServerAdministratorinterface.Youcannotinstallituntilyoufinishconfiguringthedataserverandbringituprunning.

Procedure1. Enterthehttps://IPaddressofthedataserverinthebrowser.2. Enteradminintheemailfieldandpasswordadminontheloginpage.3. UndertheAdministrationtab,clicktheConfigurationtab.4. ClicktheDesktopSettingslinkundertheApplicationcolumnontheSystem

Configurationpage.5. ClicktheDownloadthedesktopclientinstallerlink.6. ClickRunwhentheinstallerwindowprompts.7. CompletetheinstallationstepsintheInstallShieldWizard.8. Aftertheinstallationiscomplete,IBMDesktopDataCollectorappearsasvolumesonthe

primarydatasourcepageofthedataserverandintheIBMStoredIQAdministratorinterfaceontheapplicationstack.

Parenttopic:ConfigurationofIBMStoredIQPlatform

IBMUnstructuredData751, p. 44

Page 54: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

CreatingatemplatefromtheIBMStoredIQOVAOVAscanbemodifiedtofituniquedeploymentscenarios.

AboutthistaskWhilebuildingcustomOVAconfigurationscanbedone,configuringtheOVAcanmaketheresultingvirtualmachineinstanceunstableorunusable.ToensurequalityimplementationofIBM®StoredIQPlatform,contactIBMsupportbeforeyoustartthecustomOVAconfiguration.

ThefollowinginformationprovidesareferenceprocedureforcreatinganewtemplatefromtheIBMStoredIQOVAbeforeyoudeploythedataserver.UsethevSphereClienttocreatethenewtemplate.

Procedure1. DeployOVAtocreateinstanceofthevirtualmachine.

Note:DonotpoweronthevirtualmachineaftersuccessfuldeploymentoftheOVA.2. Right-clickonthevirtualmachineandselectEditSettings.3. Changetheprocessorandmemoryasneeded.4. Tochangethesizeofadisk,firstremoveitssizeandthenaddbackthesizeyouwant.

Note:Donotusethismethodtoresizetheprimarydisk.5. ClickFile>Export>ExportOVFTemplate.

IBMUnstructuredData751, p. 45

Page 55: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

EditingtheOVFfileIfyouneedtoscaledownthesizeoftheindexdriveonthedataservers,youcanedittheOVFfile.

BeforeyoubeginToprepareyoursystemforthechangeoftheOVFfile,youneed:

AreleasedStoredIQDataServerOVAAsystemwiththetarandopensslutilitiesandatexteditorSufficientdiskspacetounpacktheStoredIQDataServerOVA(about4GB).

AboutthistaskIfyouarecomfortablewiththeOVFmetadatastandardandOVApackaging,reducingthesizeoftheDataServerindexdrivecanbeaccomplishedbyextractingtheOVFfileandmanuallyeditingtherelevantparameters.

Procedure1. UnpacktheStoredIQDataServerOVAarchivewiththetarutilityinthecurrent

directory:tarxvf<filename>.Youcanseeatotalofthreefiles,withextensionsofovf,mf,andvmdk.gz2.

2. Editthe.ovffileinonelinewiththetexteditorofyourchoice,specifyingthesize(ovf:capacity)inGBfordisk(ovf:diskID)vmdisk.Note:Thesizefor"Harddisk2"foraproductiondeploymentmustbe300GBorgreater.300GBistheminimumsizeforametadataonlyindexfor10TBofmanagedstorage.

<Diskovf:capacity="1984"ovf:capacityAllocationUnits="byte*2^30"ovf:diskId="vmdisk2"ovf:format="http://www.vmware.com/interfaces/specifications/vmdk.html#streamOptimized"/>

3. Updatethemffilewiththesha1hashfortheovfandvmdkfileswiththeopensslutility:openssldgst-sha1<filename>.ovf,<filename>.mf,<filename>-disk1.vmdk.gz.

4. RebuildtheOVAarchivewiththetarutility.Note:Theorderofthefilelistisimportant.Theovffilemustbeaddedfirstfollowedbythemffileandthenthevmdkfile:tarcvf<filename>.ova<filename>.ovf<filename>.mf<filename>-disk1.vmdk.gz

5. Cleanupthefilesthatareaddedtotheovaarchive.rm-f*.{ovf,mf,vmdk.gz}6. DeploytheupdatedOVA.InvSphere,verifythesizeof"Harddisk2"fortheresulting

virtualmachinetoensurethatitmatchesthesizethatisspecifiedintheovffile.7. Poweronthevirtualmachineandconfigureitfromtheconsole.8. Confirmappropriateoperationofvirtualmachineafterinitialconfigurationcompletes

andthevirtualmachinerestarts.

IBMUnstructuredData751, p. 46

Page 56: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ApplicationdatamigrationApplicationdatacanbemovedfromanoldsystemtoanewoneindifferentoperationsystems.

Youmusthaveadministrativeprivilegeswithinyourvirtuemachineenvironmenttoperformthefollowingprocedures.

MigratingdataofthedataserverYoucanmovealldatabyswappingthevirtualmachinedisk.MigratingdataofthegatewayFollowthisproceduretomigratedatainthegateway.MigratingdataoftheapplicationstackFollowthesestepstomigratedataoftheapplicationstack.EnablingpublicorprivateinfosetsWhenyouenablepublicorprivateinfosets,youmightwanttorestricttheAllDataandAllSysteminfosetstoonlythoseusersintheadministratorrole.Itgivesadministratorsmorecontrolovervolumevisibility.ItdoesnotmakesensetohaveaprivateinfosetthatrestrictsaccesstocertainvolumeswhileusersarestillabletoaccessthosevolumesthroughtheAllDatasysteminfoset.Torestrictaccesstotheseinfosets,contactyourtechnicalsupporttoruntheappropriateprocedureontheappstack.

IBMUnstructuredData751, p. 47

Page 57: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

MigratingdataofthedataserverYoucanmovealldatabyswappingthevirtualmachinedisk.

Procedure1. Locateyouroldsystemandwritedownthenameofthevirtualmachineofthesystem.2. Createacloneofthissystembeforeyouproceedtothenextstep.3. Turnofftheoldsystem.4. DeployanewsystemwiththelatestOVA.5. Turnonthenewsystem.6. GothroughalltheinitialpromptstoacceptEULA.Waitforinitializationscripttorunto

completion.Note:Itisimportanttogothroughthisprocessbeforeyouproceedtothenextstep.Withoutthisprocess,theinitializationscriptcaneraseallthedata.Ensurethatyournewsystemisinstalledandyoucanbringtheuserinterfacesuccessfully.

7. Turnoffthenewsystem.8. Right-clickthevirtualmachineandselectEditSettings.UndertheHardware,youcan

seeHardDisk1,HardDisk2,HardDisk3installedonSCSI(0:0),SCSI(0:1),SCSI(0:2).9. SelectHardDisk2,whichis2TBdisk,andclickRemove.10. UnderRemovaloptions,selectRemovefromvirtualmachineandclickOK.Ittakesa

momentforthedrivetoberemoved.11. Right-clickthenewvirtualmachineandselectEditSettingsagain.12. UndertheHardwaretab,youcanseeHardDisk1,HardDisk2.ClickAdd....13. UnderDeviceType,selectHardDiskandclickNext.14. UnderSelectaDisk,selectUseanexistingvirtualdiskorReuseapreviouslyconfigured

virtualdisk.15. UnderSelectExistingDisk,browsetoDiskFilePath,wheretheoldVMdiskwiththe

datatobemigratedis.Forexample,[XXVMDatastore]centosX/centosX_vmdk16. UnderAdvancedOptions,selectVirtualDeviceNodeSCSI(0:1).17. UnderReadytoComplete,reviewtheselectionoptionscarefullyandclickFinishtoadd

thehardware.Ittakesamomentforthedrivetobeadded.18. Right-clickthenewsystemandselectEditSettings.Youcanseethreeharddisks.19. Turnonyournewsystem.Ensurethatallthedeepfilerservicesareupandrunningand

starttheuserinterface.20. Verifythatallthedatawasmovedsuccessfully.Afterverification,youcandeletetheold

system.Note:ThedrivethatwasusedforaswapisstilllocatedunderoldvirtualmachinefolderintheVMwaredatastore.

Parenttopic:Applicationdatamigration

IBMUnstructuredData751, p. 48

Page 58: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

MigratingdataofthegatewayFollowthisproceduretomigratedatainthegateway.

Procedure1. Logontoyouroldsystemandrunthiscommand:pg_dumpall-Udfuser-c-fdb_file.out.A

fileiscreated.2. Bringthenewvirtualmachineupandrunning.3. Sshintothenewvirtualmachine.ThefilethatiscreatedinStep1cannowbemoved

overtothenewvirtualmachineandusedtorestorethedataonthenewsystem.4. Followthesecommands:

a. Stopallservicesonthenewvirtualmachine:servicesiqinitstopb. Verifythattheservicesarerunning:servicedeepfilerstatusc. Starttherestoreprocess:psql-Upostgres-dpostgres-fdb_file.outd. Restarttheservices:servicesiqinitrestarte. Verifythattheservicesarerunning:servicedeepfilerstatus

5. WhentheservicesareupandrunningonRedhatvirtualmachine,loginthroughtheuserinterfaceandverifywhetherthedatawasrestoredsuccessfully.

Parenttopic:Applicationdatamigration

IBMUnstructuredData751, p. 49

Page 59: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

MigratingdataoftheapplicationstackFollowthesestepstomigratedataoftheapplicationstack.

Procedure1. Logontotheapplicationstacksystem.2. Runthiscommand:/siq/env/postgresql/bin/pg_dumpall-Upostgres-c-fdb_file.outAfile

iscreated.3. Bringthenewvirtualmachineupandrunning.4. Sshintothenewvirtualmachine.ThefilethatwascreatedinStep2cannowbemoved

overtothenewvirtualmachineandusedtorestorethedataonthenewsystem.5. Followthesesteps:

a. Starttherestoreprocess:/siq/env/postgresql/bin/psql-Upostgres-dpostgres-fdb_file.out

b. Restarttheservices.c. WhentheservicesareupandrunningonRedhatvirtualmachine,loginthroughthe

userinterfaceandverifywhetherthedatawasrestoredsuccessfully.d. Copy/etc/siq/gateway/yamland/etc/siq/local.yamlovertothenewsystem.

Parenttopic:Applicationdatamigration

IBMUnstructuredData751, p. 50

Page 60: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

EnablingpublicorprivateinfosetsWhenyouenablepublicorprivateinfosets,youmightwanttorestricttheAllDataandAllSysteminfosetstoonlythoseusersintheadministratorrole.Itgivesadministratorsmorecontrolovervolumevisibility.ItdoesnotmakesensetohaveaprivateinfosetthatrestrictsaccesstocertainvolumeswhileusersarestillabletoaccessthosevolumesthroughtheAllDatasysteminfoset.Torestrictaccesstotheseinfosets,contactyourtechnicalsupporttoruntheappropriateprocedureontheappstack.

AboutthistaskTheprocedurethatisoutlinedhererestrictsaccessoftheAllDataandAllSystemsysteminfosetstoonlythoseusersintheadministratorrole.Thepublicorprivatefeaturedoesnotapplytothesetwoinfosets.Thisscriptremovestheconvenienceofthesesysteminfosetsthatareseenbyallusers.Agoodpracticeofenablingthisfeatureistocreatethesysteminfoset,whichcontainsallvolumesthatmustbepublic.

Procedure1. SSHontotheappstack.2. OpenPostgresandrunthisscript:

#!/siq/bin/ipython#Thisisautilitytogenerateapublicmixed-levelsysteminfosetfromallcurrentlyactivevolumes#makesuretochmoda+xthisfiletomakeitexecutablefromdatetimeimportdatetimefrommesh.standardimportbindfrommesh.transport.httpimportHttpClientclassBindings(object):def__init__(self):self.models={}defbind(self,url,bundle,targets,mixins=None):client=HttpClient(url,bundle=bundle).register()forname,pathintargets.iteritems():self.models[name]=bind(client.specification,path)defexpose(self,instance_name='bindings'):ip=get_ipython()fornameinself.models:ip.ex("%s=%s.models['%s']"%(name,instance_name,name))bindings=Bindings()bindings.bind('http://localhost:9998/','docket.entity',{'Infoset':'docket.entity/1.0/enamel/1.0/infoset',},['enamel.husk.infoset'])bindings.bind('http://localhost:9999/api.enamel','enamel',{'DataSource':'enamel/1.0/datasource',})bindings.expose()formatted_time=datetime.now().strftime('%b%d,%Y%H:%M:%S')public_all_data_objects_name='PublicAllDataObjects-{0}'.format(formatted_time)datasources=DataSource.query().filter(status='active').all()composition={'type':'datasource-list','datasources':[{'id':ds.id}fordsindatasources]}

IBMUnstructuredData751, p. 51

Page 61: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

public_all_data_objects=Infoset.create(name=public_all_data_objects_name,description=public_all_data_objects_name,type='mutable',composition=composition)print'Createdinfoset:',public_all_data_objects_name

Parenttopic:Applicationdatamigration

IBMUnstructuredData751, p. 52

Page 62: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

CustomizablereportsReportingisakeystepwithinthedata-managementprocessasitvalidatesthatprocesseswerecompletedcorrectlywithinIBM®StoredIQ.

Note:Youmustenablespecificconfigurationsettingstoutilizethisfunctionality.ContactIBMLabServicesforfurtherassistance.Youcancustomizereportsinanyofthesescenarios:

Modifyreportstocarryyourorganization'scustomstyles,logos,aligningthemwithotherorganization-basedartifactsanddocumentation.Altertheformatofthecontentreportedinexistingreports.Forexample,youcanaddmorecolumns,switchaxesinagraph,changetheunitsforsomevalues.Designreportstocontaininformationthatisnotfoundinother,existingreports.

UsingODBCoranyclientthatsupportsremoteaccesstoPostgreSQL,youcanconnecttoeithertheIBMStoredIQappserverorthegateway,locatingaschemathatisnamedreport_schema.Onboththeseservertypes,report_schemacanbeaccessedremotelybylogginginasareportuser,whichisanaccountthatiscreatedforthepurposesofreportingonIBMStoredIQdata.

Note:Contactyouradministratorforreportusercredentialsfortheappstackandgateway.

AppstackThesetablesareavailableforreporting(withSELECTaccessonly)fromthereport_schemaontheenameldatabaseontheappstack.

infosetinfoset_overlaynamed_filterquery_filter

ThesetablesprimarilycarryinformationaboutinfosetsandfiltersthatarecreatedinIBMDataWorkbench.

GatewayThesetablesareavailableforreporting(withSELECTaccessonly)fromthereport_schemaonthedfdatadatabaseonthegateway.

distribution_by_accessedtimedistribution_by_filetypedistribution_by_sizedistribution_by_filesystemdistribution_by_modtimedistribution_by_objectclassdistribution_by_objectclass_by_owners_by_agedistribution_by_objectclass_by_owner_by_filetypedistribution_by_objectclass_by_owner_by_sizedistribution_by_objectclass_by_ownerdistribution_by_owner_by_createdtimedistribution_by_owner_by_modtimedistribution_by_owner_by_accessedtimedistribution_by_owner_by_filetypedistribution_by_owner_by_sizevolumes

The"volumes"tablelistsallthedatasourcesthataredefinedonalldataservers.Thetablesthathave"distribution"intheirprefixescarrysummarizedinformationforvariousmetricsforeachinfoset.TheinfosetsarereferencedbytheirIDshere.Themappingtotheirnamesisavailablefromtheappstacktables.Each"distribution"tablereportssummariesfor"nodecounts"(numberofdataobjectsinagrouping)and"totalsize"(totalsizeinbytesofdataobjectsinagrouping).

IBMUnstructuredData751, p. 53

Page 63: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

InstallingtheBIRTReportDesignerTheBIRTReportDesignerprovidescorereportingfeaturessuchasreportlayout,datasourceconfiguration,andscriptingfeaturesthatrendercontentandlayoutdynamicallyduringreportgeneration.InstallingtheBIRTReportDesignerisarequirementforcustomizingreports.UploadingthereportdesignIBMStoredIQsupportsuploadingareportdesigninaZIPpackage.Reportdesignsareexpectedtobeintherptdesignformatwithinthecompressedfile.Currently,onlyonerptdesignisexpectedtobepresentwithinacompressedfile.Thedesigncanuseoneormore.CSSstylefilesandoneormoreimagefiles,whichcanallbepackagedwithinthecompressedfile.DeployingfontsBydefault,theIBMStoredIQreportingenginesupportsonlycertainfontsthatareprovidedwiththeproduct.ChangingthereportuserpasswordIfneeded,thepasswordforthereportuseraccountonboththegatewayandtheappstackcanbechanged.

IBMUnstructuredData751, p. 54

Page 64: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

InstallingtheBIRTReportDesignerTheBIRTReportDesignerprovidescorereportingfeaturessuchasreportlayout,datasourceconfiguration,andscriptingfeaturesthatrendercontentandlayoutdynamicallyduringreportgeneration.InstallingtheBIRTReportDesignerisarequirementforcustomizingreports.

Procedure1. InstallEclipse,whichcanbedownloadedfromhttp://download.eclipse.org/.2. DownloadBIRTfromhttp://download.eclipse.org/birt/downloads/.Note:SeveraldifferentpackagescontainBIRT.Youneedtheall-in-onedownload,whichmustbeinstalledonyourworkstation,specificallyBIRTversion4.3.2.YoucanalsoplaceBIRTintoyourexistingEclipseenvironmentwiththeEclipseUpdateManager-BIRTUpdateSite.

InstallingtheJDBCdriverAJDBCdriverisneededtoworkwithremotePostgreSQLdatabaseswithBIRT.AddingdatasourcesThegatewayandappstackdatabasesactastheprimarydatasourcesformostreportingprojects.SettingreportparametersSomereportparametersmustbeprovidedwhenyourenderthereport.AddingdatasetsAreport'schartsandtablesarebuiltondatasets,whichcaneitherusedatafromthegatewayorfromtheappstack.Youcanalsodefineajointdatasetthatjoinsdatasetsfromboththeappstackandthegateway.TestingreportdesignsReportdesignerscantesttheirdesignsintheBIRTReportDesigneritselfusingthepreviewfeature,whichisanHTMLrenderingofthereport.

Parenttopic:Customizablereports

IBMUnstructuredData751, p. 55

Page 65: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

InstallingtheJDBCdriverAJDBCdriverisneededtoworkwithremotePostgreSQLdatabaseswithBIRT.

Procedure1. Downloadthepostgres_9.2JARfilefromthehttp://jdbc.postgresql.org/download.html.2. StartEclipse.ClickFile>New>Project,andinBusinessIntelligenceandReporting

Tools,selectReportProject.3. ClickNew>Report,andintheAddanewDataSourcedialogbox,selectJDBCData

Source.4. ClickNext,andthencompletethetextboxeswithintheEditDataSourcedialogbox.5. ClickManageDrivers.6. ClickAddtoaddthedownloadedPostgreSQLJDBC.JARfile.

Parenttopic:InstallingtheBIRTReportDesigner

IBMUnstructuredData751, p. 56

Page 66: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

AddingdatasourcesThegatewayandappstackdatabasesactastheprimarydatasourcesformostreportingprojects.

AboutthistaskWhenyoucreateadatasourceforeitherthegatewayorappstackdatabase,becertaintoselectJDBCDataSourceasthedatasourcetype.

Procedure1. IntheDriverClasstextbox,enterorg.postgresql.Driver(v9.2)2. IntheDatabaseURLtextbox,enterjdbc:postgresql://x.x.x.x/enamel,wherex.x.x.xisthe

IPaddressorDNSresolvablehostnameoftheappstack.Note:Whenthedatasourcethatisbeingcreatedisforthegateway,thisURLisused:jdbc:postgresql://x.x.x.x/dfdata,wherex.x.x.xistheIPaddressorresolvablehostnameofthegateway.

3. IntheUserNametextbox,enterreportuser.4. InthePasswordtextbox,enterthepasswordthatisassociatedwiththisusername.

Note:Youradministratormightsetdifferentpasswordsfortheappstackandthegateway.Contactyouradministratortoreceivethispassword.

5. ClickTestConnectiontoensurethataconnectioncanbeestablishedwiththeremotedatabase.

Parenttopic:InstallingtheBIRTReportDesigner

CreatingaconnectionprofileWhenyoucreatedatasourcesrepeatedly,youcancreateaconnectionprofileasanalternative.

Procedure

1. Whenyoucreateanewdatasource,clickCreatefromaconnectionprofileintheprofilestore.

2. FromSelectaConnectionProfile,clickNew.3. ClickNewandthenselectBIRTJDBCDataSource,providingtheconnectiondetails

specifictoeithertheappstackorthegateway.4. IntheSpecifyfilenametextbox,enteranameforyourconnectionprofile.

Results

Aftertheconnectionprofileiscreated,itcanbereusedwhenyoucreateanewdatasource.SelectCreatefromaconnectionprofileintheprofilestoreandthenbrowsetoselecttheprofilefromtheavailablelist.

IBMUnstructuredData751, p. 57

Page 67: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

SettingreportparametersSomereportparametersmustbeprovidedwhenyourenderthereport.

AboutthistaskCurrently,IBM®StoredIQsupportsonlyonereportparameter,whichmustmaptoInfoSetID.Itistheonlyparameterthatcanbesuppliedwhenyourenderthereport.

Procedure1. Createareportparameter.2. Enterausefulnamesuchasinfoset_id.3. Forthemessagethatmustbedisplayedtotheuserthatrendersthereport,enterthe

textinthePrompttexttextbox.4. SelecttheappropriateDataType,DisplayType,andIsRequiredvalues.ForanInfoSet

IDparameter,thesevaluesmustbesettoString,TextBox,orTrue.

Parenttopic:InstallingtheBIRTReportDesigner

IBMUnstructuredData751, p. 58

Page 68: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

AddingdatasetsAreport'schartsandtablesarebuiltondatasets,whichcaneitherusedatafromthegatewayorfromtheappstack.Youcanalsodefineajointdatasetthatjoinsdatasetsfromboththeappstackandthegateway.

Procedure1. Tocreateanappstackdataset:

a. Createadataset.b. Selectthepreviouslynameddatasourcethatreferencestheappstack.c. Enteravalidname.d. EnteranSQLquerythatfetchessomedatabackfromthereport_schema.Ifyourdata

settargetsinfosetdata,itcarriesawhere-clausethatlookslikewhereinfoset_id=?.The?denotesthatareportparametermustbeusedhere.

e. IfareportparameteristobeusedintheSQLquery,youmustaddaparametertothedataset.

ClickParameters>New.ChangetheLinkedtoReportParametervaluefromNonetothenameofyourreportparameterthatiscreatedduringdatasetcreation.

2. Tocreateagatewaydataset:a. Createadataset.b. Selectthepreviouslynameddatasourcethatreferencesthegateway.c. Enteravalidname.d. EnteranSQLquerythatfetchessomedatabackfromthereport_schema.Ifyourdata

settargetsinfosetdata,itcarriesawhere-clausethatlookslikewhereinfoset_id=?::uuid.The?denotesthatareportparametermustbeusedhere.Thetype-casttouuidisimportantonthegateway.

e. IfareportparameteristobeusedintheSQLquery,youmustaddaparametertothedataset.

ClickParameters>New.Acceptthedefaultvaluesinthisdialogbox;however,theLinkedtoReportParametervaluemustbechangedfromNonetothenameofthereportparameterthatiscreatedinthepreviousstep.

Parenttopic:InstallingtheBIRTReportDesigner

IBMUnstructuredData751, p. 59

Page 69: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

TestingreportdesignsReportdesignerscantesttheirdesignsintheBIRTReportDesigneritselfusingthepreviewfeature,whichisanHTMLrenderingofthereport.

AboutthistaskBeforeyouuploadthecustomizedreport,youmustpreviewthereportasbothHTMLandasaPDF.Ithelpstoensurethatthereportrendersproperlyontheappstack.

Procedure1. InEclipse,openyourcustomdesign.2. ClickPreviewtoviewtheHTMLpreviewofthecustomreport.3. ClickRun>Runas>PDFtoviewthePDFrenderingofthereport.

Parenttopic:InstallingtheBIRTReportDesigner

IBMUnstructuredData751, p. 60

Page 70: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

UploadingthereportdesignIBM®StoredIQsupportsuploadingareportdesigninaZIPpackage.Reportdesignsareexpectedtobeintherptdesignformatwithinthecompressedfile.Currently,onlyonerptdesignisexpectedtobepresentwithinacompressedfile.Thedesigncanuseoneormore.CSSstylefilesandoneormoreimagefiles,whichcanallbepackagedwithinthecompressedfile.

AboutthistaskTobettermanagetheartifactssuchastheimagesandstylesheetsforasinglereportdesignpackage,youmustdooneofthefollowingtasks.Byselectingoneofthereport-designmanagementoptions,youcanmanageallimagesandstylesheets.Theyareusedbythedesigninasinglelocation,makingthecreationoftheZIPpackageeasierasyoucompressafolder.

Createaprojectforeachreportdesign.Itmeansthateachprojectcontainsonlyonerptdesign.Createafolderforeachreportdesignwithintheproject.Itmeansthateachfoldercontainsonlyonerptdesign.

Additionally,theuploadedcompressedfilemustmeetthefollowingrequirements:

Itcontainsonlyonerptdesignfileandusesthefileextension.rptdesign.AllCSSandimagesthatarereferencedfromtherptdesignarealsopresentwithinthecompressedfile.Onlyonereportparameterisdefinedintherptdesign.Imagesusetheseextensions:.bmp,.jpg,.jpeg,.jpe,.jfif,.gif,.png,.tif,.tiff,.ico,or.svg.Stylesheetsmustusethe.cssfileextension.

Parenttopic:Customizablereports

IBMUnstructuredData751, p. 61

Page 71: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DeployingfontsBydefault,theIBM®StoredIQreportingenginesupportsonlycertainfontsthatareprovidedwiththeproduct.

AboutthistaskBydefault,theIBMStoredIQreportingenginesupportsthefollowingfonts:

icon-webfont.ttfubuntu-bold-italic.ttfubuntu-bold.ttfubuntu-medium-italic.ttfubuntu-medium.ttfubuntu-regular-italic.ttfubuntu-regular.ttf

Procedure1. Deploythefontstotheappserver.Copythefontstothisfolderontheappstack:/usr/share/fonts/default/TrueType.Note:OnlyTrueTypeFontsaresupported.Ifafontisusedinthereportdesignandisnotdeployedcorrectlyontheappstack,thedefaultTimesNewRomanfontisusedwhenyourenderthereport.

2. RestartIBMStoredIQservices.IBMStoredIQservicesmustberestartedontheappstackafternewfontsaredeployed.

Parenttopic:Customizablereports

IBMUnstructuredData751, p. 62

Page 72: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ChangingthereportuserpasswordIfneeded,thepasswordforthereportuseraccountonboththegatewayandtheappstackcanbechanged.

Procedure1. Tochangethepasswordforthereportuserontheappstack:

a. Logintotheappstackoversshasroot.b. Runthe/siq/bin/change_reportuser_passwordscriptwiththenewpasswordforthe

reportuserasaparameter.2. Tochangethepasswordforthereportuseronthegateway:

a. Logintothegatewayoversshasroot.b. Copythe/siq/bin/change_reportuser_passwordfromtheappstack.c. Runthisscriptwiththenewpasswordforthereportuserasaparameter.

Parenttopic:Customizablereports

IBMUnstructuredData751, p. 63

Page 73: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

InstallingtheLivelinkAPIsTheLivelinkAPIrequirestheinstallationofthelapi.jar,whichisprovidedbyitsvendor,OpenText,underlicensetotheircustomers.IBMcannotredistributethisfile.Atinstallation,youmustcopythisfiletoeachdataserverinthe/usr/local/IBM/ICI/vendordirectory.ItislikelytobefoundontheLivelinkserverintheC:\OPENTEXT\application\WEB-INF\libdirectory.However,Livelinkinstallationscanvary;youmustconsultthecustomer'sdocumentationtolocatethelapi.jarfile.

Procedure1. Locatethelapi.jarfilebygoingtoC:\OPENTEXT\application\WEB-INF\lib.

Note:Installationsvarybycustomer.Ifthelapi.jarfileisnotintheC:\OPENTEXT\application\WEB-INF\libdirectory,consultthecustomer'sdocumentation.

2. Copythelapi.jarfiletoeachdataserverinthe/usr/local/IBM/ICI/vendordirectory.

IBMUnstructuredData751, p. 64

Page 74: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

AdministeringIBMStoredIQIBM®StoredIQsolutionsprovideservicestomanagetheIBMStoredIQAdministratorapplicationanddataservers.

WiththeservicesfortheIBMStoredIQAdministratorapplication,youcanmanage:

DataserversandvolumesSysteminfosetsUsersActionsTargetsetReportsAuto-classificationmodelsConcepts

Withtheservicesforthedataservers,youcanmanage:

SystemadministrationIBMStoredIQPlatformconfigurationVolumesanddatasourcesDataharvestingJobconfigurationDesktopcollectionFoldersAuditsandlogsDeploymentofcustomizedwebservices

AdministeringIBMStoredIQAdministratorUseIBMStoredIQAdministratortoconfigureshares,createsysteminfosets,manageusers,targetsets,andactions,andcreatereports.AdministeringIBMStoredIQPlatformDataServerThefollowingtopicsprovideinstructionsonhowtoconductadministrativetaskssuchasadministeringappliance,configuringIBMStoredIQPlatform,andcreatingvolumesanddatasource.

IBMUnstructuredData751, p. 65

Page 75: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

AdministeringIBMStoredIQAdministratorUseIBM®StoredIQAdministratortoconfigureshares,createsysteminfosets,manageusers,targetsets,andactions,andcreatereports.

OverviewofIBMStoredIQAdministratorDataServersandVolumesTheDataServersandVolumespageofIBMStoredIQAdministratorcontainstheDataDashboard,whereyouseealldatacurrentlyundermanagement,AllDataServerstab,AllVolumestab,andPerformancetab.SysteminfosetsSysteminfosetscanbecreatedinIBMStoredIQDataWorkbenchtoallowuserstohaveadifferentstartingpointthantheAllDataObjectsinfoset.UsermanagementFromtheUserManagementpage,userscanbedefinedandprovidedwithlogininformationsothattheycanusetheapplicationstack.ActionmanagementActionsrepresentexecutableprocessesthatactuponindexeddatawithindataservers.UsetheActionManagementpagetocreateandmodifyactionsthatareusedbyIBMStoredIQAdministrator.TargetsetsSomeactions,namelycopyactions,requireadestinationtocomplete,andatargetsetrepresentsamappingforeachdataserverofthewantedtargetvolume.Tocopyfiles,thedataservermustknowwheretocopythefileto.Eachdataservermustbeconfiguredwithalistoftargetvolumes,suchasretentionanddiscoveryexportvolumes.ReportsIBMStoredIQcontainsanumberofdefaultreportsandtheabilitytouploadareportpackage.Auto-classificationmodelsAuto-classificationmodels,alsocalledautomateddocumentcategorization,integratestheIBM®ContentClassification'sclassificationmodelintotheIBMStoredIQinfoset-generationprocess.ConceptmanagementWithinIBMStoredIQPlatform,youcanusetheconcept-managementfeaturetorelatebusinessideastoindexeddata.

Parenttopic:AdministeringIBMStoredIQ

IBMUnstructuredData751, p. 66

Page 76: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

OverviewofIBMStoredIQAdministratorIBM®StoredIQAdministratorprovidesat-a-glanceunderstandingofthedifferentissuesthatcancropupintheIBMStoredIQPlatformenvironment.TheseviewsareuniquetotheIBMStoredIQAdministratorapplication,providinganoverviewofhowthesystemisrunning.Theseviewsalsoallowaccesstovariouspiecesofinformationthataresharedacrossapplicationsorallowforthemanagementofresourcesinacentralizedmanner.

TheAdministratoristhepersonresponsibleformanagingtheIBMStoredIQPlatforminstallationatacustomersite.Thisindividualhasstrongunderstandingofdatasources,harvests,indexes,dataservers,jobs,infosets,reports,concepts,andactions.ThislistprovidesanoverviewastohowIBMStoredIQAdministratorworks.

ManagingDataServersUsingIBMStoredIQAdministrator,theAdministratorcanidentifywhatdataserversaredeployed,theirlocation,whatdataisbeingmanaged,andthestatusofeachdataserverinthesystem.VolumemanagementisacentralcomponentofIBMStoredIQPlatform.WithIBMStoredIQAdministrator,theAdministratorcansee:

WhatvolumesarecurrentlyundermanagementWhichdataserverisresponsibleforthatvolumeThestateofthevolumeafterindexingTheamountandsizeofinformationthatiscontainedbyeachvolume.

Administratorscanalsoaddvolumestodataserversthroughthisinterface.AdministeringHarvests

AdministratorscaninitiatetheincrementalorfullharvestofasinglevolumethroughtheIBMStoredIQAdministratoruserinterfacewithouthavingtologintoIBMStoredIQPlatformDataServer.

CreatingSystemInfosetsSysteminfosetsthatuseonlyspecificindexedvolumescanbecreatedandmanagedwithinIBMStoredIQAdministrator.AlthoughinfosetsareacorecomponentofIBMStoredIQDataWorkbench,systeminfosetsarecreatedasashortcutforusersinIBMStoredIQAdministrator.

ManagingUsersTheusermanagementareaallowsadministratorstocreateusersandmanageusers'accesstothevariousIBMStoredIQPlatformapplications.

ConfiguringandManagingActionsAnactionisanyprocessuponthedatathatisrepresentedbytheindexes.Actionsarerunbydataserversonindexeddataobjects.AnyerrorsorwarningsthataregeneratedasaresultofanactionarerecordedasexceptionsinIBMStoredIQDataWorkbench.Note:ActionscanbecreatedwithinIBMStoredIQAdministratorandthenmadeavailabletootherIBMStoredIQPlatformapplicationssuchasIBMStoredIQDataWorkbench.

ManagingtargetsetsProvidesaninterfacethatallowstheusertosetthewantedtargetsforspecificactionsthatrequireadestinationvolumefortheiractions.

CreatingreportsHelpsyoutocreatereportsanduploadreportpackages,helpingyoutoproducereportsaboutyourenvironment.

UsingAuto-classificationModelsDeploysnaturallanguageprocessing-baseddocumentclassificationtohelpyouidentifyrelevantdocumentsincaseswhenrelevanceisdifficulttocharacterizewithtraditionalmethods,suchasqueriesandsetoperations.

ManagingConceptsHelpsyoutorelatebusinessconceptstoindexeddata.

SwitchingbetweenapplicationsWiththeIBMStoredIQproduct,youcanswitchbetweendifferentapplications.

IBMUnstructuredData751, p. 67

Page 77: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

SwitchingbetweenapplicationsWiththeIBM®StoredIQproduct,youcanswitchbetweendifferentapplications.

AboutthistaskTheseapplicationsinclude:

IBMStoredIQDataWorkbenchIBMStoredIQeDiscoveryIBMStoredIQDataScriptIBMStoredIQPolicyManagerIBMStoredIQAdministrator

Toswitchtotheapplicationthatyouwanttoworkon,followthesesteps.

Procedure1. Withintheglobalnavigationbar,clickthewhitearrownexttothenameofthe

application.Amenuappears,listingavailableIBMStoredIQPlatformapplications.2. Inthemenu,clickthenameoftheapplicationtowhichyouwanttoswitch.

Note:Therearefiverolesforusers:administrator,datauser,discoveryuser,policyuser,andSDKuser.DifferentIBMStoredIQPlatformapplicationsareavailabletotheuser,dependingonwhatroleswereselected.AdministratorshaveaccesstoIBMStoredIQAdministratorinadditiontoIBMStoredIQDataWorkbench,IBMStoredIQeDiscovery,andIBMStoredIQDataScript.DiscoveryusershaveaccesstoIBMStoredIQeDiscovery.DatausershaveaccesstoIBMStoredIQDataWorkbench.PolicyusershaveaccesstoIBMStoredIQPolicyManager.TheSDKuserroleisenabledonlyforusersoftheIBMStoredIQSDK.IndividualswiththeSDKuserrolemusthaveboththeadministratorandSDKuserrolesinordertoworkwiththeIBMStoredIQSDK.ItshouldalsobenotedthatusersassignedonlytheSDKuserrolecannotlogintoanyoftheIBMStoredIQapplications.

Parenttopic:OverviewofIBMStoredIQeDiscovery

IBMUnstructuredData751, p. 68

Page 78: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DataServersandVolumesTheDataServersandVolumespageofIBM®StoredIQAdministratorcontainstheDataDashboard,whereyouseealldatacurrentlyundermanagement,AllDataServerstab,AllVolumestab,andPerformancetab.

DataDashboardThedescriptionoftheDataDashboardfieldsislistedinthefollowingtable.

Table1.DataDashboardfieldsanddescriptionsDataDashboard DescriptionTotalDataObjects Thisfieldliststhetotalnumberofdataobjectsundermanagement.TotalDataSize Thisfieldliststhetotalsizeofdataobjectsundermanagement.NumberofDataServers Thisfieldliststhetotalnumberofdataserversundermanagement.

NumberofVolumes Thisfieldliststhetotalnumberofvolumesundermanagement.

AllDataServersAllDataServerstabliststhedetailedinformationaboutthedataservers

Table2.AllDataServerstabcolumnnamesanddescriptionsAllDataServersColumnName Description

Dataservername Liststhenameofthedataserver.

Status Liststhedataserver'sstatus,namelyHealthy,Vulnerable,Critical,orUnavailable.

IPaddress ListstheIPaddressofthedataserver.Dataobjects Liststhenumberofdataobjectsthatarefoundonthedataserver.Totaldataobjectsize Liststhesizeofthedataobjectsthatarefoundonthedataserver.Availablespace Liststheamountoffreespaceonthedataserver.Loadaverage Liststheloadaverage.

AllVolumesThetabprovidesthedetailedinformationaboutthevolumes.

Table3.AllVolumestabcolumnnamesanddescriptionsVolumesColumn

Name Description

Volumename Liststhenameofthevolume.Dataserver Liststhenameoftheparentdataserver.

TypeListsthevolume'stype,namelyPrimary,Retention,orDiscoveryExport.Primaryindicatesaprimaryvolume.Retentionindicatesaretentionvolume.DiscoveryExportindicatesadiscoveryexportvolume.

Sourcetype Liststhesourceorconnectiontypeforthevolume.Servername Liststhenameoftheserverwherethevolumeisfound.Dataobjects Liststhenumberofdataobjectsthatarefoundonthevolume.

Totaldataobjectsize Liststhesizeofthedataobjectsinthevolume.Lastharvested Denotesthelasttimethatthevolumewasharvested.

IBMUnstructuredData751, p. 69

Page 79: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Lastharvested Denotesthelasttimethatthevolumewasharvested.

PerformanceThistabprovidestheperformanceinformationofthedataservers.

Table4.PerformancetabcolumnnamesanddescriptionsPerformanceColumnName Description

Dataservername Liststhenameofthedataserver.

Status Liststhedataserver'sstatus,namelyHealthy,Vulnerable,Critical,orUnavailable.

IPaddress ListstheIPaddressofthedataserver.

Activedbconnection Liststhenumberofdatabaseconnectionscurrentlyopenfortheselecteddataserver.

Freememory Denotestheamountofavailablememory(RAM)fortheselecteddataserver.

Freeswapmemory Denotestheamountofavailableswapmemoryfortheselecteddataserver.

Loadaverage Liststheaverageprocessloadfortheselecteddataserver.Lastcommunication Liststhelasttimethedataserverthatisconnectedtothegateway.Uptime Liststhetotaldurationoftimeforwhichthedataserverran.

SearchingforaspecificdataserverWhenyouhavemultipledataserversavailablefromwhichtochoose,youcansearchforaspecificdataserverinsteadofusingtheslidertomovethroughavailableoptions.AddingaprimaryvolumeAprimaryvolumeservesasaprimarydatasourceinIBMStoredIQPlatform.Youmusthaveatleastoneprimaryvolumewithinyourconfiguration.AddingaretentionvolumeAretentionvolumestoresdataobjectsthatareplacedunderretention,meaningthattheobjectisretainedforaspecifiedperiod.AddingadiscoveryexportvolumeAdiscoveryexportvolumecontainsdatathatisproducedfromadiscoveryexportaction.Thatdataiskeptsothatitcanbeexportedasaloadfileanduploadedintoalegalreviewtool.ViewingdetailsofadataserverDetailedinformationforanydataserverorvolumecanbeviewed.ViewingperformanceofadataserverTheabilitytocheckthestatusofalldeployeddataserversiscriticaltounderstandingthesystem'sperformancemetrics.

IBMUnstructuredData751, p. 70

Page 80: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

SearchingforaspecificdataserverWhenyouhavemultipledataserversavailablefromwhichtochoose,youcansearchforaspecificdataserverinsteadofusingtheslidertomovethroughavailableoptions.

Procedure1. IntheEnterkeyterm(s)...textbox,enterthenameofthedataserverforwhichyouwant

tosearch,andthenclickSearch.Youcanentereitherthefulldataservernameoraportionofit.Toremovethesearchterm,clicktheXtotheleftoftheEnterkeyterms....textbox.Actionsthatmatchtheenteredsearchtermarereturned.

2. Selectadataserverfromthereturnedlistofservers.3. Viewthedataserver'sdetailsbyclickingViewDetails.

Parenttopic:DataServersandVolumes

RelatedconceptsDataServersandVolumes

IBMUnstructuredData751, p. 71

Page 81: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

AddingaprimaryvolumeAprimaryvolumeservesasaprimarydatasourceinIBM®StoredIQPlatform.Youmusthaveatleastoneprimaryvolumewithinyourconfiguration.

Procedure1. SelectDataServers&Volumes>AllDataServers,selectadataserver,andthenclick

AddVolume.TheAddVolumedialogboxappears.2. IntheAddVolumedialogbox,completethesefields:

Table1.PrimaryvolumeoptionsAddVolumedialogboxoption Action Notes Applicablesource

types

VolumeType IntheVolumeTypelist,selectPrimary.

CIFSExchangeFileNetLivelinkNewsGatorNFSSharePoint

SourceTypeIntheSourceTypelist,selecttheserver'sconnectionorsourcetype.

CIFSExchangeFileNetLivelinkNewsGatorNFSSharePoint

Server

IntheServertextbox,enterthefullyqualifieddomainnameoftheserverfromwhichthevolumeisavailableformounting.

CIFSExchangeFileNetLivelinkNewsGatorNFSSharePoint

UsernameIntheUsernametextbox,entertheusernamethatisusedtoconnecttoandmountthevolume.

CIFSExchangeFileNetLivelinkNewsGatorSharePoint

PasswordInthePasswordtextbox,enterthepasswordthatisusedtoconnecttoandmountthevolume.

CIFSExchangeFileNetLivelinkNewsGatorSharePoint

AssigntoDataServer

IntheAssigntoDataServerlist,selectthedataserver.

CIFSExchangeFileNetLivelinkNewsGatorNFSSharePoint

VolumeNameIntheVolumeNametextbox,enterthecommonnameofthisvolume.

CIFSExchangeFileNetLivelinkNewsGator

IBMUnstructuredData751, p. 72

Page 82: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

volume. NewsGatorNFSSharePoint

FileNetDomain IntheFileNetDomaintextbox,entertheFileNetdomain. FileNet

Share IntheSharetextbox,enterthesharenameorthisvolume. CIFS

ExportIntheExporttextbox,entertheexportnameforthisvolume.

NFS

SiteURLIntheSiteURLtextbox,enterthesiteURLoftheSharePointserver.

SharePoint

ObjectStore IntheObjectStoretextbox,entertheobjectstore. FileNet

ConnectionType IntheConnectionTypelist,selecteitherHTTPorHTTPS. FileNet

Port InthePorttextbox,enteraportnumber. FileNet

Livelink

Database IntheDatabasetextbox,enterthedatabasename. Livelink

Searchslice IntheSearchslicetextbox,enterthesearchslice. Livelink

ServerVersion

IntheServerVersionlist,selecttheversionofMicrosoftExchange,choosingfrom2000/2003,2007,or2010.

Exchange

MailboxServerIntheMailboxServertextbox,enterthenameofthemailboxserver.

Exchange

ActiveDirectoryServer

IntheActiveDirectoryServertextbox,enterthenameoftheActiveDirectoryserver.Tousesecuresocketlayer,selecttheUseSSLcheckbox.

Exchange

Path InthePathtextbox,entertheappropriatedirectorypath. FileNet

Stanza IntheStanzatextbox,entertheappropriatestanza. FileNet

InitialDirectoryIntheInitialDirectorytextbox,enterthenameoftheinitialdirectoryfromwhichtheharvestmustbegin.

CIFSExchangeFileNetLivelinkNewsGatorNFSSharePoint

VirtualRootIntheVirtualRoottextbox,changethedefaultnametomatchtheExchangeserverdesignation.

ForExchange,thisoptionmustbechangedtomatchtheserverdesignation.

Exchange

IndexingOptions

Selectthecheckboxfortheindexingoptionsthatyouwanttoinclude:

Includemetadataforcontainedobjects

Theseoptionsarenotselectedbydefault.

CIFSExchangeFileNetLivelinkNewsGator

IBMUnstructuredData751, p. 73

Page 83: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

containedobjectsIncludecontenttaggingandfull-textindex

default. NewsGatorNFSSharePoint

3. ClickSavetosaveyourconfigurationsandaddthevolume.4. ClicktheAllVolumestab.Noticethattheaddedvolumeappearstherein,listedasa

primaryvolume.Toharvestthisnewlyaddedvolume,selectthatvolumeandthenclickHarvest.

Parenttopic:DataServersandVolumes

RelatedconceptsDataServersandVolumes

IBMUnstructuredData751, p. 74

Page 84: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

AddingaretentionvolumeAretentionvolumestoresdataobjectsthatareplacedunderretention,meaningthattheobjectisretainedforaspecifiedperiod.

Procedure1. ClickDataServers&Volumes>AllDataServers,andthenclickAddVolume.TheAddVolumedialogboxappears.

2. IntheAddVolumedialogbox,completethesefields:Table1.Retentionvolumeoptions

AddVolumedialogboxoption

Action Notes Sourcetype

VolumeType IntheVolumeTypelist,selectRetention.

CIFSNFS

SourceType IntheSourceTypelist,selectthesourceorconnectiontype.

CIFSNFS

ServerIntheServertextbox,enterthefullyqualifieddomainnameoftheserverfromwhichthevolumeisavailableformounting.

CIFSNFS

UsernameIntheUsernametextbox,entertheusernamethatisusedtoconnecttoandmountthevolume.

CIFS

PasswordInthePasswordtextbox,enterthepasswordthatisusedtoconnecttoandmountthevolume.

CIFS

AssigntoDataServer

IntheAssigntoDataServerlist,selectadataserver.

CIFSNFS

VolumeNameIntheVolumeNametextbox,enterthecommonnameofthisvolume.

CIFSNFS

Share IntheSharetextbox,enterthesharenameforthisvolume. CIFS

Export IntheExporttextbox,entertheexportnameforthisvolume. NFS

IndexingOptions

Selectthecheckboxfortheindexingoptionsthatyouwanttoinclude:

IncludemetadataforcontainedobjectsIncludecontenttaggingandfull-textindex

Theseoptionsarenotselectedbydefault.

CIFSNFS

3. ClickSavetosaveyourconfigurationsandaddthevolume.Retentionvolumesdonothaveanydatatoharvestuntilacopytoretentionruns.

4. ClicktheAllVolumestab.Theaddedvolumeappears,listedasaretentionvolume.

Parenttopic:DataServersandVolumes

RelatedconceptsDataServersandVolumes

IBMUnstructuredData751, p. 75

Page 85: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

AddingadiscoveryexportvolumeAdiscoveryexportvolumecontainsdatathatisproducedfromadiscoveryexportaction.Thatdataiskeptsothatitcanbeexportedasaloadfileanduploadedintoalegalreviewtool.

Procedure1. ClickDataServers&Volumes>AllDataServers,andthenclickAddVolume.TheAddVolumedialogboxappears.

2. IntheAddVolumedialogbox,completethesefields:Table1.Discoveryexportvolumeoptions

AddVolumedialogboxoption

Action Notes Sourcetype

VolumeType IntheVolumeTypelist,selectDiscoveryExport.

CIFSNFS

SourceType IntheSourceTypelist,selectthesourceorconnectiontype.

CIFSNFS

ServerIntheServertextbox,enterthefullyqualifieddomainnameoftheserverfromwhichthevolumeisavailableformounting.

CIFSNFS

UsernameIntheUsernametextbox,entertheusernamethatisusedtoconnecttoandmountthevolume.

CIFS

PasswordInthePasswordtextbox,enterthepasswordthatisusedtoconnecttoandmountthevolume.

CIFS

AssigntoDataServer

IntheAssigntoDataServerlist,selectthedataserver.

CIFSNFS

VolumeName IntheVolumeNametextbox,enterthenameofthisvolume.

CIFSNFS

Share IntheSharetextbox,enterthesharenameforthisvolume. CIFS

Export IntheExporttextbox,entertheexportnameforthisvolume. NFS

3. ClickSavetosaveyourconfigurationsandaddthevolume.4. ClicktheAllVolumestab.Theaddedvolumeappears,listedasadiscoveryexportvolume.

Parenttopic:DataServersandVolumes

RelatedconceptsDataServersandVolumes

IBMUnstructuredData751, p. 76

Page 86: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ViewingdetailsofadataserverDetailedinformationforanydataserverorvolumecanbeviewed.

Procedure1. ClickDataServers&Volumes>AllDataServers,andthenclickViewDetails.The<data

servername>Detailspageappears,showingtheAllDataServersandAllVolumestabs.2. SelecttheAllDataServerstab,selecttheitemforwhichyouwanttoviewitsdetails,and

thenclickViewDetails.Note:Toviewdetailsformultipleitems,pressCtrlandselectthoseitems,andthenclickViewDetails.Asummaryofthedataserver'sdetailsappearsalongwiththeVolumesandPerformancetabs.

Parenttopic:DataServersandVolumes

RelatedconceptsDataServersandVolumes

IBMUnstructuredData751, p. 77

Page 87: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ViewingperformanceofadataserverTheabilitytocheckthestatusofalldeployeddataserversiscriticaltounderstandingthesystem'sperformancemetrics.

Procedure1. ClickDataServers&Volumes>AllDataServers,andthenclickViewDetails.The<dataservername>Detailspageappears,showingtheVolumesandPerformance.

2. SelectthePerformancetab,andthedataserver'sperformancedetailsappears.

Parenttopic:DataServersandVolumes

RelatedconceptsDataServersandVolumes

IBMUnstructuredData751, p. 78

Page 88: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

SysteminfosetsSysteminfosetscanbecreatedinIBM®StoredIQDataWorkbenchtoallowuserstohaveadifferentstartingpointthantheAllDataObjectsinfoset.

Systeminfosetsarethebasisforuser-createdinfosets.Systeminfosetsallowadministratorstoselectwhichindexedvolumestheinfosetcandrawupon,creatingashortcutforIBMStoredIQDataWorkbenchusers.Actionscannotberunonsysteminfosets,butonlyonuser-createdinfosets.Therefore,youmustfirstcreatethesysteminfosethereinIBMStoredIQAdministratorandthencreateauserinfosetthatcanbeacteduponinIBMStoredIQDataWorkbench.

Infosetscanbepublicorprivate.Theadministratordeterminesusers'accesstosysteminfosetsatthetimeofcreation.TheAllDataObjectsandAllSystem-LevelObjectsinfosets,whicharegeneratedbytheapplication,aresettoadminbydefaultandcanbeviewedonlybyanadministrator.

Note:Systeminfosetsmustnotbeusedtomanagevolumesorindexes.Additionally,systeminfosetsmustbecreatedjudiciously.Ifthereareseveralsysteminfosetsthroughwhichausermustcull,theshortcutaspectisremoved.

Table1.InfosetmanagementcolumnnamesanddescriptionsInfosetManagement

ColumnName Description

Name Liststhenameofthesysteminfoset.Thisnamemustbeuniqueagainstallinfosets.

Totalobjects Liststhetotalnumberofdataobjectsthatarecontainedwithinthesysteminfoset.

Infosetsize Listssizeofthesysteminfoset.

InusebyIndicatestheinfosetsinwhichthissysteminfosetisused.Ifthesysteminfosetisinuse,alinkisshown,indicatingthenumberofinfosetsbywhichthesysteminfosetisbeingused.Clickthelinktoseewhichinfosetsusethissysteminfoset.

Access

Indicateswhetherthesysteminfosetispublicorprivate.Ifthesysteminfosetispublic,itcanbeviewedbyanyuser.Ifthesysteminfosetisprivate,itcanbeviewedbyonlythoseusersgrantedpermissionbytheadministrator.Ifusersaregrantedpermission,thenumberofusersislistedwithahyperlinktotheAccessMembersmodal,whichliststhenameandroleofuserswhohaveaccess.

Description Thiscolumnliststheoptionaldescriptionofthesysteminfoset.

SearchingforaspecificsysteminfosetWhenyouhavemultiplesysteminfosetsavailabletochoose,youcansearchforaspecificsysteminfosetinsteadofusingtheslidertomovethroughavailableoptions.CreatingasysteminfosetSysteminfosetscanbecreatedwithselectedvolumes,creatingashortcutforIBMStoredIQDataWorkbenchusers.EditingasysteminfosetExistinguser-createdsysteminfosetscanbemodifiedasneeded.ViewinginfosetsthatuseasysteminfosetClickthelinktoviewwhichinfosetsusetheselectedsysteminfoset.ViewingaccessmembersDeletingasysteminfosetSysteminfosetscanbedeletedfromtheListofInfosetspageiftheyarenotinusebyotherinfosets.Whenasysteminfosetisinusebyadirectancestorofotherinfosets,Deleteisunavailableforusesothatthesysteminfosetcannotbedeleted.

IBMUnstructuredData751, p. 79

Page 89: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

SearchingforaspecificsysteminfosetWhenyouhavemultiplesysteminfosetsavailabletochoose,youcansearchforaspecificsysteminfosetinsteadofusingtheslidertomovethroughavailableoptions.

Procedure1. IntheEnterkeyterm(s)...textbox,enterthenameofthesysteminfosetforwhichyouwanttosearch,andthenclickSearch.Youcanentereitherthefullsysteminfosetnameoraportionofit.Toremovethesearchterm,clicktheXtotheleftoftheEnterkeyterm(s)....textbox.Systeminfosetsthatmatchtheenteredsearchtermarereturned.

2. Selectasysteminfosetfromthereturnedlistofsysteminfosets.

Parenttopic:Systeminfosets

RelatedconceptsSysteminfosets

IBMUnstructuredData751, p. 80

Page 90: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

CreatingasysteminfosetSysteminfosetscanbecreatedwithselectedvolumes,creatingashortcutforIBM®StoredIQDataWorkbenchusers.

Procedure1. ClickSystemInfosets,andthenclickCreateInfoset.TheAddSystemInfosetdialogbox

appears.2. IntheAddSystemInfosetdialogbox,completethesefields.

a. IntheInfosetNametextbox,enterthenameofthissysteminfoset.b. IntheDescriptionofInfosettextbox,enterabriefdescriptionofthissysteminfoset.

Thisinfosetmightneedtobeusedbyseveralpeople,soanaccuratedescriptioncanbehelpfultoothers.

c. IntheAccessarea,clickeitherPublicorPrivate.TheAllDataObjectsandAllSystem-LevelObjectsinfosets,whicharegeneratedbytheapplication,canbeviewedonlybyanadministrator.Systeminfosetsthatarecreatedbyanadministratordefaulttopublic.Publicsysteminfosetsarevisibleandavailabletoallusers,includingusersthatwillbeaddedatafuturetime.Forpublicsysteminfosets,theuserlistisdisabled.

d. Forprivatesysteminfosets,thelistofavailableusersbecomesactive.Selecttheusersforwhomthisprivateinfosetcanbeseen.Ifnousersareselectedforaprivatesysteminfoset,thenonlyadministratorscanseethatsysteminfosetbecausetheyhaveadministrativerightstoeveryinfoset.Note:Accesscannotbeedited.Itmustbedeterminedatthetimeofinfosetcreation.

e. Addvolumestothisinfoset.IntheAvailableVolumesarea,selectthevolumesthatyouwanttoaddtothissysteminfoset,andthenclickAdd.Toremovevolumesfromtheinfoset,selectthevolumeinSelectedVolumesandthenclickRemove.

3. ClickSavetosavethesysteminfoset.ItnowappearsontheListofInfosetspage.

Parenttopic:Systeminfosets

RelatedconceptsSysteminfosets

IBMUnstructuredData751, p. 81

Page 91: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

EditingasysteminfosetExistinguser-createdsysteminfosetscanbemodifiedasneeded.

Procedure1. IntheListofInfosetspage,selectthesysteminfosetthatyouwanttoedit,andthenclick

EditInfoset.TheEditSystemInfosetdialogboxappears.Note:Onlycreatedinfosetscanbeedited.

2. IntheEditSystemInfosetdialogbox,edittheinfosetasneeded.Note:Accesscannotbeedited.Itmustbedeterminedatthetimeofinfosetcreation.

3. ClickSavetosaveyourchanges.

Parenttopic:Systeminfosets

RelatedconceptsSysteminfosets

IBMUnstructuredData751, p. 82

Page 92: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ViewinginfosetsthatuseasysteminfosetClickthelinktoviewwhichinfosetsusetheselectedsysteminfoset.

Procedure1. Selectthesysteminfosetforwhichyouwouldlikewhatotherinfosetsusethesystem

infoset.2. IntheInusebycolumn,clickthelink.TheSysteminfosetmodalforthesysteminfoset

appears,listingtheinfosetsthatuseit.3. ClickClose.

Parenttopic:Systeminfosets

RelatedconceptsSysteminfosets

IBMUnstructuredData751, p. 83

Page 93: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Viewingaccessmembers

Procedure1. Selectthesysteminfosetforwhichyouwouldliketoaccessitsmembers,andthenclick

thelinkintheAccesscolumn.TheAccessMemberswindowappears,listingboththeusernamesandrolesofallmembersofthesysteminfoset.Note:Thecolumnscanbesortedtoshowmembersinascendingordescendingorder.

2. ClickClose.

Parenttopic:Systeminfosets

RelatedconceptsSysteminfosets

IBMUnstructuredData751, p. 84

Page 94: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DeletingasysteminfosetSysteminfosetscanbedeletedfromtheListofInfosetspageiftheyarenotinusebyotherinfosets.Whenasysteminfosetisinusebyadirectancestorofotherinfosets,Deleteisunavailableforusesothatthesysteminfosetcannotbedeleted.

Procedure1. IntheListofInfosetspage,selectthesysteminfosetthatyouwanttodelete,andthenclickDeleteInfoset.Note:TheAllDataObjectsandAllSystem-LevelObjectssysteminfosetscannotbedeleted.TheDeleteInfosetwindowappears.

2. ClickDeletetodeletetheselectedsysteminfoset.Thesysteminfosetisdeletedfromthelistofavailablesysteminfosets.

Parenttopic:Systeminfosets

RelatedconceptsSysteminfosets

IBMUnstructuredData751, p. 85

Page 95: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

UsermanagementFromtheUserManagementpage,userscanbedefinedandprovidedwithlogininformationsothattheycanusetheapplicationstack.

ThistablelistsanddescribesallofthefieldsthatareseenwithintheListofUserspage.Whenauserisselected,thatusercanbeviewed,edited,ordeleted.

Table1.ListofUserscolumnnamesanddescriptionsListofUserscolumnname Description

Username TheusernamethatisassignedtotheuserFirstname Theuser'sfirstorgivennameLastname Theuser'slastorsurnameEmailaddress Theuser'semailaddress.Systemnotificationsaresenttothisemailaddress.

Role Theuser'srole.OptionsincludeAdmin,DataUser,DiscoveryUser,PolicyUser,orSDKUser.

Status

Theuser'sstatus.OptionsincludeActiveorInactive.

Activeuserscanloginandusetheproduct.Activeisthedefaultstatusforauser.InactiveuserscannotlogintotheproductsuitebecausetheiraccountisrenderedinactivebytheAdministrator.Wheninactiveusersattempttologin,theyarenotifiedthattheirloginisinvalidandthattheymustcontactanAdministrator.

Lastlogin Thedateandtimeofthemostrecentuserlogin.Iftheuserisnotloggedintothesystem,N/Aisshown.

ViewingyouruserprofileWhenyouareviewingyouruserprofile,youcanseevariousaspects,includingyourassignedroles.SearchingforaspecificuserWhenyouhavemultipleusersavailabletochoose,youcansearchforaspecificuserinsteadofusingtheslidertomovethroughavailableoptions.CreatingauserWithinIBM®StoredIQPlatform,auserauthenticatestoandinteractswiththeproductsuite.Whenauseriscreated,thisusercanloginandusethesystem.EditingauserYoucanmodifyexistingusers,includingtheirstatusasneeded.YoucanalsoactivatethedisableduserswithinIBMStoredIQAdministrator.ViewingdetailsofauserBasicuserinformationsuchasfirstandsurname,emailaddress,androlecanbeviewedbyclickingViewDetails.DeletingauserYoucandeleteexistingusersfromthesystemasneeded;however,thelogentriesofadeleteduserarealsodeleted.Incertaininstances,itisagoodpracticethatyouchangeauser'sstatus.ChanginguserpasswordsEithertheuserortheadministratorcanchangepasswords.Validpasswordsareatleast8charactersinlengthandcontainatleastanuppercaseletter,alowercaseletter,anumber,andaspecialcharacter.ResettingtheuserpasswordUserpasswordscanbesetandresetasneededbyusersandadministratorsalike.ObtaininganewpasswordUsersoccasionallyneedtoobtainnewpasswordstobeabletologintothesystem.

IBMUnstructuredData751, p. 86

Page 96: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ViewingyouruserprofileWhenyouareviewingyouruserprofile,youcanseevariousaspects,includingyourassignedroles.

Procedure1. Withintheinterface,clickthedownarrowtotherightofyourusername,andthenselect

ViewProfile.TheViewProfilewindowappears,showingvariouspiecesofdata,includingyourname,role,andemailaddress.

2. Tochangeyourpassword,clickChangePassword.3. ClickClosetoclosetheViewProfilewindow.

Parenttopic:Usermanagement

RelatedconceptsUsermanagement

IBMUnstructuredData751, p. 87

Page 97: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

SearchingforaspecificuserWhenyouhavemultipleusersavailabletochoose,youcansearchforaspecificuserinsteadofusingtheslidertomovethroughavailableoptions.

Procedure1. IntheEnterkeyterm(s)...textbox,entertheusernameoftheuserforwhichyouwanttosearch,andthenclickSearch.Toremovethesearchterm,clicktheXtotherightoftheEnterkeyterm(s)...textbox.Usersthatmatchtheenteredsearchtermarereturned.

2. Selectausernamefromthereturnedlistofusernames.

Parenttopic:Usermanagement

RelatedconceptsUsermanagement

IBMUnstructuredData751, p. 88

Page 98: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

CreatingauserWithinIBM®StoredIQPlatform,auserauthenticatestoandinteractswiththeproductsuite.Whenauseriscreated,thisusercanloginandusethesystem.

Procedure1. ClickUsers,andthenclickCreateUser.TheAddUser-Detailsdialogboxappears.2. IntheAddUser-Detailsdialogbox,completethesefields.

a. IntheUsernametextbox,entertheusernameoftheindividual.Itisgenerallyashort,uniquename,nottheperson'sfullname.

b. IntheFirstnametextbox,enterthefirstorcommonnameoftheuser.c. IntheLastnametextbox,enterthelastorsurnameoftheuser.d. IntheEmailaddresstextbox,entertheuser'semailaddress.

Note:BecauseUsernameandEmailaddressareuniquefields,userscanlogintothesystembyenteringeithertheiremailaddressortheirusername.

e. InthePasswordtextbox,enterthepasswordforthisuser.Note:Passwordsmustbeatleast8charactersinlengthandcontainatleastoneofeachofthesecharacters:anuppercaseletter,alowercaseletter,anumber,andaspecialcharacter.

f. IntheRe-enterpasswordtextbox,entertheuser'spasswordagain.g. IntheRolelist,selecttheuser'srole.OptionsincludeAdmin,DataUser,Discovery

User,PolicyUser,orSDKUser.Ausercanbeassignedmultiplerolesbyselectingthecheckboxesintherolelist.Note:ThedefaultoptionduringusercreationisDataUser.

h. IntheStatuslist,selecttheuser'sstatus.OptionsincludeActiveorInactive.Note:ThedefaultoptionduringusercreationisActive.

i. ClickSave,andtheuseriscreated.ThenewlycreateduserappearswithintheUserManagementpage.

Parenttopic:Usermanagement

RelatedconceptsUsermanagement

IBMUnstructuredData751, p. 89

Page 99: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

EditingauserYoucanmodifyexistingusers,includingtheirstatusasneeded.YoucanalsoactivatethedisableduserswithinIBM®StoredIQAdministrator.

AboutthistaskNote:Usersbecomedisabledafterthreefailedlog-inattempts.Itisdifferentthanauserrenderedinactive,whichcanbedoneonlybyanadministrator.

Procedure1. ClickUsers,andthenselectthenameoftheuserthatyouwanttoedit.2. ClickEditUser.TheEditUser-Detailsdialogboxappears.3. IntheEditUser-Detaildialogbox,modifythefieldsasneeded.

Note:Tomodifyauser'sstatus,selectthewanted,changedstatusintheStatuslist.Note:Ifyouareanadministratorandyouarechangingauser'spassword,clicktheSendresetpasswordemaillink.

4. ClickSave,andtheediteduserinformationissaved.

Parenttopic:Usermanagement

RelatedconceptsUsermanagement

IBMUnstructuredData751, p. 90

Page 100: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ViewingdetailsofauserBasicuserinformationsuchasfirstandsurname,emailaddress,androlecanbeviewedbyclickingViewDetails.

Procedure1. WithintheUserManagementpage,selectthenameoftheuserforwhichyouwantto

viewdetails.2. ClickViewDetails,andtheViewUserDetailswindowappears.3. WithintheViewUserDetailswindow,thefollowinginformationcanbeseen:

Option Description

UserName

Theusernameoftheselecteduser.

FirstName

Thefirstorgivennameoftheselecteduser.

LastName

Thelastorsurnameoftheselecteduser.

EmailAddress

Theemailaddressoftheselecteduser.

RoleTheroleoftheselecteduser.Aroleisanamedcollectionofpermissibleactivitieswithinthesystem.Basedontheassignedroleoftheselecteduser,thatindividualcanorcannotdocertainthingswithinthesystem.

Status Thestatusoftheselecteduser.Optionsincludeactiveorinactive.

LastLogin

Thelastdateandtimeatwhichtheselecteduserloggedintothesystem.

4. Toviewtheuser'saccesslog,clicktheViewaccessloglink.TheViewAccessHistoryLogwindowappears,showingthesystementriesfortheselecteduser.Withintheentries,youseesystemactivitiessuchassuccessfullogins,unsuccessfullogins,whenapasswordwaschanged.ToclosetheViewAccessHistoryLogwindow,clickClose.Note:Thesecolumnscanbesortedbyclickingtheupanddownarrowstotherightofthecolumnname.

5. ToclosetheViewUserDetailswindow,clickClose.

Parenttopic:Usermanagement

RelatedconceptsUsermanagement

IBMUnstructuredData751, p. 91

Page 101: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DeletingauserYoucandeleteexistingusersfromthesystemasneeded;however,thelogentriesofadeleteduserarealsodeleted.Incertaininstances,itisagoodpracticethatyouchangeauser'sstatus.

Procedure1. ClickUsers,andthenselectthenameoftheuserthatyouwanttodelete.2. ClickDeleteUser.TheDeleteUserwindowappears.Note:Ifyouopttodeleteauser,thenanylogfilesthatareassociatedwiththisuserarealsodeleted.

3. Toconfirmthatyouwanttodeletetheuser,clickDelete.TheconfirmationDeleteUserwindowappears,confirmingthattheuserwasdeletedfromthesystem.

Parenttopic:Usermanagement

RelatedconceptsUsermanagement

IBMUnstructuredData751, p. 92

Page 102: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ChanginguserpasswordsEithertheuserortheadministratorcanchangepasswords.Validpasswordsareatleast8charactersinlengthandcontainatleastanuppercaseletter,alowercaseletter,anumber,andaspecialcharacter.

AboutthistaskThepasswordresetinteractioncanoccurinfourways:

AuserclickstheForgotpasswordlinkontheloginpage,leadingtheusertochangethepassword.AuserclickstheDidnotreceivepassworddetailsorChangedyouremailaddresslinkwithintheloginscreenfromanyoftheapplications.Usersviewtheirprofileandopttochangetheassociatedpassword.Anadministratoreditsauser'sprofileandoptstoresettheassociatedpassword.Anemailisthensenttotheuser,forcingindividualstochangetheirpassword.

Procedure1. Withintheemailyourreceivedregardinghowtochangeyourpassword,clicktheprovidedlink.TheChangeYourPassworddialogboxappears.

2. IntheOldpasswordtextbox,enterthepreviouslyusedpasswordforthisuser.Note:Ifthepasswordenteredinthistextboxdoesnotmatchtheonelistedinthesystem'sdatabaserecords,aredwarningmessageappears.Reentertheoldpassword.

3. IntheNewpasswordtextbox,enteranewpasswordforthisuser.4. IntheRe-enternewpasswordtextbox,typethepasswordagain.Note:ThepasswordsthatareenteredintotheNewpasswordandRe-enternewpasswordtextboxesmustbeidenticalandmeetthesystem'ssecurityrequirements.Iftheentereddataisnotidentical,aredwarningappears.

5. ClickSave.Acongratulatorymessageappears,confirmingthatyourpasswordischanged.ClickOKtoclosethewindow.

Parenttopic:Usermanagement

RelatedconceptsUsermanagement

IBMUnstructuredData751, p. 93

Page 103: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ResettingtheuserpasswordUserpasswordscanbesetandresetasneededbyusersandadministratorsalike.

AboutthistaskTherearetwowaystoresetapassword:

Foradministrators,clicktheSendresetpasswordemaillinkintheEditUserDetailswindow.Foruserswhoresettheirownpasswords,usethefollowingprocedure.

Procedure1. Fromtheapplicationloginscreen,clicktheForgotyourpasswordlink.TheReset

Passworddialogboxappears.2. IntheEmailAddresstextboxoftheResetPassworddialogbox,entertheemailaddress

wherealinktochangethepasswordmustbesent.ThisemailaddressmustbelinkedwithyouraccountinIBM®StoredIQAdministrator.

3. ClickSubmit.Aconfirmationwindowappears,statingthatanemailwithinstructionsforchangingyourpasswordwassent.

4. ClickOKtoclosetheResetPasswordwindow.

Parenttopic:Usermanagement

RelatedconceptsUsermanagement

IBMUnstructuredData751, p. 94

Page 104: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ObtaininganewpasswordUsersoccasionallyneedtoobtainnewpasswordstobeabletologintothesystem.

Procedure1. Fromtheapplication'sloginscreen,clicktheDidnotreceiveapasswordlink.2. Contactyoursystemadministratoraboutobtaininganewpassword.

Parenttopic:Usermanagement

RelatedconceptsUsermanagement

IBMUnstructuredData751, p. 95

Page 105: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ActionmanagementActionsrepresentexecutableprocessesthatactuponindexeddatawithindataservers.UsetheActionManagementpagetocreateandmodifyactionsthatareusedbyIBM®StoredIQAdministrator.

WithIBMStoredIQAdministrator,youcancreatethesetypesofactions:

Copy:Thecopyactioncopiesinfosetstoatargetset.Youcanspecifythedirectorystructureandsecuritysettingsforcopieddataobjects.Ifadataobjectexistswiththesamename,thenthesubsequentdataobjectsthatareencounteredarerenamed.

CopytoRetention:Thecopytoretentionactioncopiesdataobjectsfromsourcevolumestoatargetsetforaspecifiedperiod.Delete:Thedeleteactionremovesdataobjectsfromthesourcevolume.

Onlydataobjects,notdirectories,aredeleted.Usecautionwhenyouaredeletingdataobjects.

DiscoveryExportEDRMXML:ThediscoveryexportactioncopiesdataobjectsandgeneratesanEDRMXMLfileforloadingintothird-partylegalreviewtools.DiscoveryExportDAT:ThediscoveryexportactioncopiesdataobjectsandgeneratesaConcordanceDATfileforloadingintothird-partylegalreviewtools.ModifyAttribute:Themodifyattributeactionsimulatessettingretentionbymanipulatingspecificattributesonobjects.Move:Themoveactionmovesdataobjectsinaninfosettoanothervolume.

Youcanspecifythedirectorystructureandsecuritysettingsformoveddataobjects.Ifadataobjectexistswiththesamename,thenthedataobjectisrenamed.Whenthesourceequalsthedestination,themoveisnotallowed.

Step-upSnippet:Thestep-upsnippetactioncanberunonaninfoset,extractingandstoringtextforanydataobjecttowhichitisapplied.Thesedatasnippetsarethenusedbyauto-classification.Infosetsobjectswithoutsnippetsarenotclassifiedforauto-classification.Note:Whenscheduledharvestsorpoliciesarerunagainstadatasource,snippetsarenotupdatedorgeneratediftheyaremissing.

Table1.ActionscolumnnamesanddescriptionsActionsColumn

Name Description

ActionName Liststhenameoftheaction.

TypeListstheactiontype,namelyCopy,CopytoRetention,Delete,ModifyAttribute,Move,DiscoveryExportXML,DiscoveryExportDAT,andStep-upSnippet.

LastModified Liststhedateandtimeatwhichtheactionwaslastmodified.TargetSetName Liststheaction'sdestinedtargetset.Description Liststheactiondescription.

SearchingforaspecificactionWhenyouhavemultipleactionsavailabletochoose,youcansearchforaspecificactioninsteadofusingtheslidertomovethroughavailableoptions.CreatinganactionActionsareprocessesthatareenactedondataobjects,whicharedefinedbyinfosets.ActionsmustbedefinedhereinIBMStoredIQAdministrator.DeletinganactionExistingactionscanbedeletedfromthelistofavailableactions.CloninganactionActionscanbeclonedorduplicated.EditinganactionExistingactionscanbemodified.

IBMUnstructuredData751, p. 96

Page 106: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

SearchingforaspecificactionWhenyouhavemultipleactionsavailabletochoose,youcansearchforaspecificactioninsteadofusingtheslidertomovethroughavailableoptions.

Procedure1. IntheEnterkeyterms...textbox,enterthenameoftheactionforwhichyouwantto

search,andthenpressSearch.Youcanentereitherthefullactionnameoraportionofit.Toremovethesearchterm,clicktheXtotheleftoftheEnterkeyterms....textbox.Actionsthatmatchtheenteredsearchtermarereturned.

2. Edit,clone,ordeletetheactionasneeded.

Parenttopic:Actionmanagement

RelatedconceptsActionmanagement

IBMUnstructuredData751, p. 97

Page 107: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

CreatinganactionActionsareprocessesthatareenactedondataobjects,whicharedefinedbyinfosets.ActionsmustbedefinedhereinIBM®StoredIQAdministrator.

AboutthistaskThestep-upsnippetactionisabuilt-inaction,meaningthatnooptionsareprovidedwithintheuserinterface.Youcannotcreateoreditastep-upsnippetactionasitisprovidedforyouasaprepopulatedoptionontheActionstab.

Procedure1. ClickActions,andthenclickCreateAction.TheAddActiondialogboxappears.2. IntheAddActiondialogbox,completethesefields.

a. IntheActionNametextbox,enterthenameofthisaction.b. IntheDescriptionofActiontextbox,enterabriefdescriptionofthisaction.This

actionmightneedtobeusedbyseveralpeople,soanaccuratedescriptioncanbehelpfultoothers.

c. IntheActionTypelist,selecttheactiontype.d. Ifyouarecreatingacopy,copytoretention,discoveryexport,modifyattribute,or

moveaction,selectatargetsetfromthecreatedactionsorcreateanewtargetset.InTargetSet,selectatargetsetorclickCreateanewtargetset.

e. ClickNexttocontinuecreatingtheaction.Dependingonthetypeofactionthatisselected,usethecorrespondingtablestobetterunderstandwhatoptionstoselect.

Copyactionoptions Action

TargetSet IntheTargetSetarea,selectatargetset.DestinationDirectory

IntheDestinationDirectorytextbox,eitherenterafilepathorusethelistoptiontoselectapreviouslyenteredfilepath.

DirectoryStructure

InDirectoryStructure,selectthecheckboxifyouwanttoRecreatedirectorystructureondestination.

Hashes InHashes,selectthecheckboxifyouwanttoComputeahashvalueforeachdataobject.

Harvesting InHarvesting,selectorclearthecheckboxforDonotauto-harvestdestinationvolumeaftercopy.

EmailMessageFormat

IntheEmailMessageFormatlist,selecttheformatoftheemailmessage.

SharePointUserProfileItems

InSharePointUserProfileItems,selectthecheckboxesofapplicationSharePointitems,includingNotes,Libraries,BlogPosts,Wikis,andMisc.

CopytoRetentionactionoptions

Action

TargetSet IntheTargetSetarea,selectatargetset.

HashesInHashes,selectthecheckboxifyouwanttoComputeahashvalueforeach

dataobject.

Harvesting

InHarvesting,selectthecheckboxtoDonotauto-harvestdestinationvolumeaftercopyifanautomaticharvestoftheretentionvolumeisnotwanted.Ifthisoptionisselected,thentheretentionvolumecanbeharvestedwiththediscoverretentionvolumesjobonthedataserver.

IBMUnstructuredData751, p. 98

Page 108: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

EmailMessageFormat

IntheEmailMessageFormatlist,selecttheformatoftheemailmessage.

RetentionTag InRetentionTag,enterthekeytermforthetag.

RetentionPeriod

InRetentionPeriod,enteranumber,andthenselectDays,Weeks,Months,orYears.

Deleteactionoptions Action

DeleteParameters

InDeleteParameters,selectthecheckboxtoDonotdeletedataobjectsthathavebeenaccessedsincelastharvest.

DiscoveryExportEDRMXMLactionoptions

Action

DestinationDirectory

IntheDestinationDirectorytextbox,eitherenterafilepathorusethelistoptiontoselectapreviouslyenteredfilepath.

UniqueIDPrefixand#ofDigits

InUniqueIDPrefixand#ofDigits,enterauniqueprefixandthenthenumberofdigitstofollowthatprefix.Forexample,ifyouenteraprefixoffeb2012with7digits,thisentryyieldsaUniqueIDsimilartoFeb2012-1234567.

SelectthecheckboxtoPadZeros.

SelectthecheckboxtoSaveatextcopy.

EmailMessageFormat

IntheEmailMessageFormatlist,selecttheformatoftheemailmessage.

LimitExportProcess

SelectthecheckboxtoLimitExportProcesstoandenterthenumberofdataobjects.

SharePointUserProfileItems

InSharePointUserProfileItems,selectthecheckboxesofapplicationSharePointitems,includingNotes,Libraries,BlogPosts,Wikis,andMisc.

DiscoveryExportDATactionoptions

Action

DestinationDirectory

IntheDestinationDirectorytextbox,eitherenterafilepathorusethelistoptiontoselectapreviouslyenteredfilepath.

UniqueIDPrefixand#ofDigits

InUniqueIDPrefixand#ofDigits,enterauniqueprefixandthenthenumberofdigitstofollowthatprefix.Forexample,ifyouenteraprefixoffeb2012with7digits,thisentryyieldsaUniqueIDsimilartoFeb2012-1234567.

SelectthecheckboxtoPadZeros.

EmailMessageFormat

IntheEmailMessageFormatlist,selecttheformatoftheemailmessage.

LimitExportProcess

SelectthecheckboxtoLimitExportProcesstoandenterthenumberofdataobjects.

SharePointUserProfileItems

InSharePointUserProfileItems,selectthecheckboxesofapplicationSharePointitems,includingNotes,Libraries,BlogPosts,Wikis,andMisc.

IBMUnstructuredData751, p. 99

Page 109: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Items SharePointitems,includingNotes,Libraries,BlogPosts,Wikis,andMisc.

ModifyAttributeactionoptions Action

ActionName IntheActionName,entertheaction'sname.ActionType IntheActionTypelist,selecttheModifyAttributeoption.

DescriptionofAction IntheDescriptionofActiontextbox,entertheaction'sdescription.

AttributeType Selectfromthefollowingoptions:Read-onlyorRead-write.

Moveactionoptions Action

DestinationDirectory

IntheDestinationDirectorytextbox,eitherenterafilepathorusethelistoptiontoselectapreviouslyenteredfilepath.

DirectoryStructure

InDirectoryStructure,selectthecheckboxifyouwanttoRecreatedirectorystructureondestination.

3. ClickSavetosaveyourchanges,clickBacktoreturntothepreviouspage,orclickCanceltocancelcreatingtheaction.

Parenttopic:Actionmanagement

RelatedconceptsActionmanagement

IBMUnstructuredData751, p. 100

Page 110: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DeletinganactionExistingactionscanbedeletedfromthelistofavailableactions.

Procedure1. IntheListofActionspage,selecttheactionthatyouwanttodelete,andthenclickDeleteAction.TheDeleteActionwindowappears.

2. ClickDeletetodeletetheselectedaction.TheactionisremovedfromtheListofActionspageanditisnolongeravailableforuse.

Parenttopic:Actionmanagement

RelatedconceptsActionmanagement

IBMUnstructuredData751, p. 101

Page 111: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

CloninganactionActionscanbeclonedorduplicated.

Procedure1. IntheListofActionspage,selecttheactionthatyouwanttoclone,andthenclickCloneAction.TheCloneActiondialogboxappears.

2. IntheCloneActiondialogbox,completethesefields.a. IntheActionNametextbox,enterthenameofthisaction.Note:Thenameoftheclonedactionmustbedifferentfromthenameoftheoriginalaction.

b. IntheActionTypelist,selecttheactiontype,andthenclickNexttocontinuecreatingtheaction.

c. IntheDescriptionofActiontextbox,enterabriefdescriptionofthisaction.Note:Thisactionmightbeusedbyseveralpeople,sothedescriptionmustbeaccurate.

d. TheselectionthatismadeintheActionTypelistdetermineswhatoptionsareavailableafteryouclickNext.Ifyouarecreatingacopy,copytoretention,discoveryexport,ormoveaction,selectatargetsetfromcreatedtargetsetsorcreateanewtargetset.InTargetSet,selectatargetsetorclickCreateanewtargetset.

e. ClickNext.Dependingonthetypeofactionthatisbeingcloned,youcanseevariousoptions.

3. ClickSavetosaveyourchanges.

Parenttopic:Actionmanagement

RelatedconceptsActionmanagement

IBMUnstructuredData751, p. 102

Page 112: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

EditinganactionExistingactionscanbemodified.

Procedure1. IntheListofActionspage,selecttheactionthatyouwanttoedit,andthenclickEdit

Action.TheEditActionsdialogboxappears.2. IntheEditActionsdialogbox,edittheactionasneeded.3. ClickSavetosaveyourchanges.

Parenttopic:Actionmanagement

RelatedconceptsActionmanagement

IBMUnstructuredData751, p. 103

Page 113: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

TargetsetsSomeactions,namelycopyactions,requireadestinationtocomplete,andatargetsetrepresentsamappingforeachdataserverofthewantedtargetvolume.Tocopyfiles,thedataservermustknowwheretocopythefileto.Eachdataservermustbeconfiguredwithalistoftargetvolumes,suchasretentionanddiscoveryexportvolumes.

TargetSetExampleDataServer1hasthreeretentionvolumes:VolumeA,VolumeB,andVolumeC.DataServer2hastworetentionvolumes:VolumeB,VolumeX,andVolumeZ.DataServer3hastworetentionvolumes:VolumeBandVolumeZ.

ResultingCopyAction:YouwouldliketocreateatargetsetforacopyactionDataServer1copiestoVolumeA.DataServer2copiestoVolumeX.DataServer3copiestoVolumeB.

AnotherusermightwanttocreateatargetsetforacopyactionwhereDataServer1,DataServer2,andDataServer3copiestoVolumeB.

Table1.TargetsetmanagementcolumnsanddescriptionsTargetsetcolumnname

Description

TargetSetName Liststhenameofthetargetset.

Type Liststhetypeofthetargetset,namelyPrimary,Retention,orExport.SourceType Liststhetargetset'ssourcetype,forexample,CIFS,NFS,orSharePoint.Volumes Liststhenumberofvolumesinthattargetset.LastModified Liststhedateandtimethatthetargetsetwaslastmodified.

Description Liststhedescriptionofthetargetset.

SearchingforaspecifictargetsetWhenyouhavemultipletargetsetsfromwhichtochoose,youcansearchforaspecifictargetsetsinsteadofusingtheslidertomovethroughavailableoptions.CreatingatargetsetRetention,copy,move,anddiscoveryexportactionsrequireanameddestinationtowhichdataobjectscanbecopied,moved,orexported.Targetsetsassociatedataserversandappropriatevolumes,providingyouractionswithadestination.EditingatargetsetTargetsetscanbeedited,modifyingthedataserversthatareassociatedwiththetargetset.CloningatargetsetTargetsetscanalsobeclonedorduplicated.DeletingatargetsetExistingtargetsetscanbedeletedfromthelistofavailabletargetsets.

IBMUnstructuredData751, p. 104

Page 114: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

SearchingforaspecifictargetsetWhenyouhavemultipletargetsetsfromwhichtochoose,youcansearchforaspecifictargetsetsinsteadofusingtheslidertomovethroughavailableoptions.

Procedure1. IntheEnterkeyterms...textbox,enterthenameofthetargetsetforwhichyouwould

liketosearch,andthenpressSearch.Youcanentereitherthefulltargetsetnameoraportionofit.Toremovethesearchterm,clicktheXtotheleftoftheEnterkeyterms....textbox.Targetsetsthatmatchtheenteredsearchtermarereturned.

2. Edit,clone,ordeletethetargetsetasneeded.

Parenttopic:Targetsets

RelatedconceptsTargetsets

IBMUnstructuredData751, p. 105

Page 115: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

CreatingatargetsetRetention,copy,move,anddiscoveryexportactionsrequireanameddestinationtowhichdataobjectscanbecopied,moved,orexported.Targetsetsassociatedataserversandappropriatevolumes,providingyouractionswithadestination.

Procedure1. ClickTargetSets,andthenclickCreateTargetSet.TheCreateTargetSetdialogbox

appears.2. IntheCreateTargetSetdialogbox,completethesefields.

a. IntheTargetSetNametextbox,enteranameforthistargetset.b. IntheDescriptionofTargetSettextbox,enteradescription.c. IntheTypeofTargetSetlist,selectthetypeofthistargetset,namelyPrimary,

Retention,orExport.d. IntheSourceTypelist,selectthesourcetypeofthistargetset,namelyCIFS,NFS,

FileNet,orSharePoint.e. IntheTargetSetListarea,clickAddDataServers.Selectadataserverandthen

clickAddtomoveittotheTargetSetListbox.ClickDonewhenyoufinishaddingdataserversforthetargetset.UsetheCtrlkeytoaddorremoveseveralselectionssimultaneously.TheaddeddataserversappearwithintheTargetSetListbox.ClickAdd/RemoveDataServerstomodifywhatdataserversappearhere.

f. IntheCreateTargetSetdialogbox,clicktheaddeddataserverandthenselectavolumeonthatdataserver.Dothisstepforeachaddeddataserver.

3. ClickSavetosaveyourconfigurationchangesandcreatethetargetset.

Parenttopic:Targetsets

RelatedconceptsTargetsets

IBMUnstructuredData751, p. 106

Page 116: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

EditingatargetsetTargetsetscanbeedited,modifyingthedataserversthatareassociatedwiththetargetset.

Procedure1. OntheListofTargetSetspage,clickthenameofthetargetsetthatyouwouldliketo

edit,andthenclickEditTargetSet.TheEditTargetSetdialogboxappears.2. Editthetargetsetfieldsasneeded.3. ClickSavetosaveyourchanges.

Parenttopic:Targetsets

RelatedconceptsTargetsets

IBMUnstructuredData751, p. 107

Page 117: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

CloningatargetsetTargetsetscanalsobeclonedorduplicated.

Procedure1. OntheListofTargetSetspage,clickthenameofthetargetsetthatyouwouldliketo

cloneorduplicate,andthenclickCloneSet.TheCloneTargetSetdialogboxappears.2. Editthetargetsetfieldsasneeded.

Note:Theclonedtargetset'snamemustbeunique.3. ClickSavetosaveyourchanges.

Parenttopic:Targetsets

RelatedconceptsTargetsets

IBMUnstructuredData751, p. 108

Page 118: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DeletingatargetsetExistingtargetsetscanbedeletedfromthelistofavailabletargetsets.

Procedure1. IntheListofTargetSetspage,selectthetargetsetyouwouldliketodelete,andthen

clickDeleteSet.TheDeleteTargetSetwindowappears.2. ClickDeletetodeletetheselectedtargetset.ThetargetsetisremovedfromtheListof

TargetSetspage,meaningthatitisnolongeravailableforuse.

Parenttopic:Targetsets

RelatedconceptsTargetsets

IBMUnstructuredData751, p. 109

Page 119: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ReportsIBM®StoredIQcontainsanumberofdefaultreportsandtheabilitytouploadareportpackage.

IBMStoredIQprovidesfeaturestoinventoryunstructureddata.Itcanthencollectandevaluateunstructureddate,compilingreportsandjobstoactonthedataaccordingtoanorganization'sneeds.Reportscanthenbeprintedanddisseminated,allowingteamstoanalyzedatainanadhocmanner.Newreportscanbeaddedbyuploadingareportpackage.

IBMStoredIQAdministratorprovidesanumberofbuilt-inreports,suchassummariesofdataobjectsinthesystem,storageuse,andthenumberofidenticaldocumentsinthesystem.Youcancreatecustomreports,includingQueryAnalysisReportsfore-discoverypurposes,andautomaticallyemailreportnotificationstoadministratorsandotherinterestedparties.Bydefault,thesetypesofreportsareavailable.

ComplianceReportCSVExceptionListExportCSVInfosetDataObjectExportDataAssessmentReportDataTopologyReportDuplicationSummaryReportOverlayHitReport

Table1.ListofReportsoptionsanddescriptionsReportcolumn

option Description

Name NameofthereportCreated ThedateandtimeatwhichthereportwascreatedDescription AdescriptionofthereportNote:ForhelpincustomizingIBMStoredIQreports,contactyourtechnicalservicerepresentative.

SearchingforaspecificreportWhenyouhavemultiplereportsfromwhichtochoose,youcansearchforaspecificreportinsteadofusingtheslidertomovethroughavailableoptions.Creatingareport

IBMUnstructuredData751, p. 110

Page 120: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

SearchingforaspecificreportWhenyouhavemultiplereportsfromwhichtochoose,youcansearchforaspecificreportinsteadofusingtheslidertomovethroughavailableoptions.

Procedure1. IntheEnterkeyterms...textbox,enterthenameofthereportforwhichyouwouldlike

tosearch,andthenpressSearch.Youcanentereitherthefullreportnameoraportionofit.Toremovethesearchterm,clicktheXtotheleftoftheEnterkeyterms....textbox.Reportsthatmatchtheenteredsearchtermarereturned.

2. Selectthewantedreport.

Parenttopic:Reports

RelatedconceptsReports

IBMUnstructuredData751, p. 111

Page 121: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Creatingareport

Procedure1. ClickReports,andthenclickCreate.TheCreateReportdialogboxappears.2. IntheCreateReportdialogbox,completethesefields.

a. IntheNametextbox,enteranameforthisreport.b. IntheDescriptiontextbox,enteradescriptionofthisreport.c. ClickChooseFile,andthenfindandselecttheappropriatereport-packagefile.

3. ClickCreate,andthenewlycreatedreportisaddedtotheListofReportspage.

Parenttopic:Reports

RelatedconceptsReports

IBMUnstructuredData751, p. 112

Page 122: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Auto-classificationmodelsAuto-classificationmodels,alsocalledautomateddocumentcategorization,integratestheIBM®ContentClassification'sclassificationmodelintotheIBM®StoredIQinfoset-generationprocess.

IBMContentClassificationIBMContentClassificationhelpsorganizeunstructuredcontentbyanalyzingthefulltextofdocumentsandemailsandapplyingrulesthatautomateclassificationdecisions.Bymanagingdocumentsandemail,youorganizeandactoncontenteveryday.IBMContentClassificationreducestheburdenofmanualdecisionmakingthatisdonebyemployeesbyaccuratelyandautomaticallyorganizinginformation.Embeddedwithnaturallanguageprocessingandsemanticanalysiscapabilities,IBMContentClassificationdeterminesthetrueintentofwordsandthenusesthatknowledgetoautomatedecisionmaking.Unlikeotherclassificationsystemsthatarebasedonrulesonly,IBMContentClassificationcombinesrulesandcontextualanalysistoincorporatereal-timelearningthatadaptstochangingbusinessneeds.Asaresult,classificationbecomesaccurateovertime.

IBMContentClassificationcanorganizeinformationbypoliciesorkeywords,butitcanalsoassignmetadatathatisbasedonthefullcontextofthedocument.Theclassificationprocessnotonlysearchesforasinglewordorphrase,butalsoanalyzestheentiredocument.Itthendistillsthemainpointofthetextandassignsthetexttoacategory.Whenitanalyzescontent,IBMContentClassificationcanrecognizemisspellings,abbreviations,jargon,andtechnicalterms.

Accuracyimprovesovertimebecausethesystemadaptstotheuniquenatureofyourbusinessbyidentifyingdifferentcategoriesfromexamplesthatyouprovide.Whenyouprovidefeedback,thesystemadjustsinrealtimeandimmediatelyimplementsanycorrectionsthatyoumake.Theaccuracyoftheclassificationresultskeepspacewithchangesinyourbusiness.

IBMContentClassificationcombinesthiscontext-basedapproachwitharule-based,decision-makingapproach.Thesystemcanidentifykeywords,patterns,suchasaccountnumbersandphonenumbersofcaseidentifiers,andwordswithinacertainproximityofeachother.Forexample,thesystemcanidentifyoccurrencesofthephrase"AttorneyGeneral"inthesamesentenceastheword"California".Whencontentthatmatchesaconditioninaruleisdetected,theactionthatisdefinedfortheruleisapplied,andthedocumentoremailisclassified.

ExamplesofclassificationapplicationsYoucanuseIBMContentClassificationtoachievevariousbusinessgoals.

Enterprisecontentstandardization:Tosupportdocumentclassificationandtaxonomyautomationwithinyourcontentmanagementsystem,documentpropertiesormetadatacanbeautomaticallyassignedwhenthecontentisclassified.Documentscanbeautomaticallymovedtothecorrectenterpriserepository.Complianceandrecordsmanagement:Documentsandemailcanbedeclaredasrecordswhentheyareclassifiedandplacedunderthecontrolofrecordretentionpoliciesandcompliancestandards.E-discoveryreadiness:Documentsandemailcanbefilteredtoensurethatonlyitemswithbusinessvalueareclassifiedandarchived.Youcanquicklyandcosteffectivelypreparecontentforpotentiallegalnotices.Businessprocessoptimization:Automateddecisionmakingensuresmoreconsistentoutcomesandreducedcosts.Withcontent-basedanalysis,youaccomplishtheseactions.

Insertdocumentsintotheworkflowofabusinessplan.Rerouteemail.Suggestandapplyagentresponseswithinacustomer-supportcenter.

IBMUnstructuredData751, p. 113

Page 123: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Usingauto-classification,youcancreateandupdateclassificationmodelstohelpmapdatawithininfosets.Thestep-upsnippetactionextractsandstorestextondataobjectswithinaninfoset.Forauto-classificationtowork,youmustusethestep-upsnippetactionsinceinfosetsobjectswithoutextractedsnippetsdonothaveauto-classificationscores.

TheDataExpertcanuseIBMContentClassificationtotrainaclassificationmodel.TheclassificationmodelisthenregisteredwiththeIBMStoredIQPlatformsystemwithIBMStoredIQAdministrator.TheregisteredclassificationmodelcanbeappliedtoanexistinginfosetinIBMStoredIQDataWorkbenchtogeneratenewmetadatafortheobjectsintheinfoset.Finally,thismetadatacanbeusedinrule-basedfilterstocreatenewinfosets.

Note:TousetheIBMStoredIQAdministratorauto-classificationfunction,usersmusthavealicensedinstallationoftheIBMContentClassificationontheirdesktop.

Applyingtheauto-classificationfeatureTousetheauto-classificationfeaturesuccessfully,youmustworkinbothIBMStoredIQAdministratorandIBMStoredIQDataWorkbench.Dataserversizing-configurationguidelinesTheinclusionoftheIBMContentClassificationserveronthedataserverchangedtherequiredmemoryandprocessors.Dataserversizing-configurationguidelinesareprovidedhere.DownloadingtheclassificationexportutilityTheclassificationexportutilityisaone-time-onlydownloadthatmustbeinstalledbeforeanimportingamodel.Buildinganauto-classificationmodelCreatingboolean-basedrulestofinddocumentsthatfitdifferingcategoriesistime-consumingandrequiresconstant,meticulousadjustments.However,importingaclassificationmodelwithsetsoftrainingdocumentshelpsfindother,similardocuments.PreparinganIBMContentClassificationmodelforimportYoumustpreparetheIBMContentClassificationmodelforimportingintoIBMStoredIQPlatformwiththeIBMContentClassificationtoolBundleDPKB.exe.Importinganauto-classificationmodelYoumustcompletethesetasksbeforeyoucanimportanauto-classificationmodel.SearchingforaspecificclassificationmodelWhenyouhavemultipleclassificationmodelstochoose,youcansearchforaspecificclassificationmodelinsteadofusingtheslidertomovethroughavailableoptions.EditingamodelThetermsandformatsthatareassociatedwithaparticularclassificationmodelchangeovertime,whichmeansthattheclassificationmodelmustalsochange.Classificationmodelscanbeeditedorupdated,modifyingthemodelfilethatisassociatedwiththatparticularclassificationmodel.DeletingamodelExistingclassificationmodelscanbedeletedfromthelistofavailablemodels,ifitwasnotusedtoenhanceaninfosetandthatinfosetstillexists.

IBMUnstructuredData751, p. 114

Page 124: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Applyingtheauto-classificationfeatureTousetheauto-classificationfeaturesuccessfully,youmustworkinbothIBM®StoredIQAdministratorandIBMStoredIQDataWorkbench.

BeforeyoubeginPriortopreparinganIBMContentClassificationmodelforimport,youmustfinishdownloadingtheclassificationexportutility,whichmustbedoneonlyonetime.TheexportutilityisusedforeachIBMContentClassificationmodelthatyouwanttoimport.

AboutthistaskIBMContentClassificationworksbytakingasamplesetofdocumentsthatyouadjust,constructingaclassificationmodel,andthenclassifyinganewdocument.TheIBMStoredIQPlatformdefinestheclassificationmodelasadecisionplanwithatleastoneknowledgebasethatisreferencedbythedecisionplan.

Procedure1. InIBMStoredIQAdministrator,ontheActiontab,thestep-upsnippetactioniscreatedautomaticallyandappearsinIBMStoredIQDataWorkbench.

2. InIBMStoredIQAdministrator,createanauto-classificationmodelbyimportingacompressedfilefromIBMContentClassification.

3. InIBMStoredIQDataWorkbench,startthestep-upsnippetaction,whichisavailableontheActtab,onaninfoset.Note:Theinfosetmustbeauserinfoset,notasysteminfoset.

4. WhilestillinIBMStoredIQDataWorkbench,applythewantedauto-classificationenhancement,whichisavailableontheEnhancetab,tothesameinfoset.

5. InIBMStoredIQDataWorkbench,applytheauto-classfilter,whichisavailableontheCreate>BuildFilterareatotheinfoset,refiningandcreatinganewinfoset.

6. Reviewtheresultsofthenewlycreatedinfoset.

Parenttopic:Auto-classificationmodels

RelatedconceptsAuto-classificationmodelsDataserversizing-configurationguidelines

IBMUnstructuredData751, p. 115

Page 125: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Dataserversizing-configurationguidelinesTheinclusionoftheIBM®ContentClassificationserveronthedataserverchangedtherequiredmemoryandprocessors.Dataserversizing-configurationguidelinesareprovidedhere.

Tosupporttheauto-classificationfunction,someofthedataserverconfigurationparameterschanged.Youmustincreasethevirtualmachinesettingsforprocessorsandmemoryondataserverstothesenewminimumsaspartofthisupdate:

Memory:16GBvCPUs:4

Requiredstorageonthedataserverfortheextractedtext(snippetcache)isroughly13%ofthesizeoftheuncompressedcontent,or130GBper1TB.Thesizecanvarydependingontheobjecttypes.Themaximumamountofextractedtextperitemisconfiguredtonotexceed2MBbydefault.

Adataserverwith2TBofconfiguredstoragecansupportapproximately10TBofmanagedstorage,assuming50milliondataobjectswithanaveragesizeof200KB.Approximately300GBismetadatastoragewiththeremaining1,700GBsupportingacombinationoffulltextandextractedtext.

Parenttopic:Auto-classificationmodels

RelatedtasksApplyingtheauto-classificationfeatureDownloadingtheclassificationexportutilityBuildinganauto-classificationmodelPreparinganIBMContentClassificationmodelforimportImportinganauto-classificationmodelSearchingforaspecificclassificationmodelEditingamodelDeletingamodel

IBMUnstructuredData751, p. 116

Page 126: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DownloadingtheclassificationexportutilityTheclassificationexportutilityisaone-time-onlydownloadthatmustbeinstalledbeforeanimportingamodel.

Procedure1. InIBM®StoredIQAdministratorontheAuto-Classificationtab,clickDownloadClassificationExportUtility.Thesiq-classification-export.zipfileisdownloaded.

2. ExtracttheexportutilitytothebindirectoryofyourIBMContentClassificationproductinstallation.ForWindows,itistypicallyintheC:\IBM\ContentClassification\Bindirectory.

Parenttopic:Auto-classificationmodels

RelatedconceptsAuto-classificationmodelsDataserversizing-configurationguidelines

IBMUnstructuredData751, p. 117

Page 127: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Buildinganauto-classificationmodelCreatingboolean-basedrulestofinddocumentsthatfitdifferingcategoriesistime-consumingandrequiresconstant,meticulousadjustments.However,importingaclassificationmodelwithsetsoftrainingdocumentshelpsfindother,similardocuments.

AboutthistaskUsingpreviouslyharvestedcustomerdata,youcancreateanauto-classificationmodel.

Procedure1. Determinethecategoriesintowhichyouwanttheauto-classificationmodeltoclassifydocuments.

2. UsingIBM®StoredIQDataWorkbench,createafilterforeachcategorytocapturedocumentsthatarerepresentativesofthecategory.

3. Foreachfilter,createaninfoset.Themembersoftheresultinginfosetbecomethe"trainingcorpus"forthecategory.

4. Foreachinfoset,runacopyactionwithIBMStoredIQDataWorkbenchontoafolderthatisaccessiblebytheIBMContentClassificationapplication.

5. UsetheIBMContentClassificationapplicationtocreateadecisionplanandknowledgebasebyimportingthetrainingcorpsthatyoucreated.Note:Aclassificationmodelconsistsofonedecisionplanandatleastoneknowledgebase,whichisarequirementoftheIBMStoredIQPlatformauto-classificationfeature.

Parenttopic:Auto-classificationmodels

RelatedconceptsAuto-classificationmodelsDataserversizing-configurationguidelines

IBMUnstructuredData751, p. 118

Page 128: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

PreparinganIBMContentClassificationmodelforimportYoumustpreparetheIBM®ContentClassificationmodelforimportingintoIBMStoredIQPlatformwiththeIBMContentClassificationtoolBundleDPKB.exe.

BeforeyoubeginIBMStoredIQPlatformdefinestheIBMContentClassificationmodelasasetofasingledecisionplanandoneormoreknowledgebasesthatarereferencedbythedecisionplan.YoumustprepareeachclassificationmodelforimportbybundlingtherelevantdecisionplanandknowledgebasewiththeIBMContentClassificationexportutilityBundleDPKB.exe.

Note:BeforeyouprepareanIBMContentClassificationmodelforimport,youmustfinishdownloadingandinstallingtheclassificationexportutility.

Procedure1. Inacommandinterface,gototheBundleDPKBinstallationdirectoryandthenenter

cscript.exeClassificationModelExporter.vbs<locationofdecisionplanprojectsandknowledgebases><decisionplandirectory><optionalemptydirectory><optionalzipfilename>.Ifyoudidnotspecifyadirectorytowhichthecompressedfilemustbeexported,anexportdirectoryiscreatedinthe<locationofdecisionplanprojectsandknowledgebases>location.

2. Notethelocationandnameofthegeneratedcompressedfile.

Parenttopic:Auto-classificationmodels

RelatedconceptsAuto-classificationmodelsDataserversizing-configurationguidelines

IBMUnstructuredData751, p. 119

Page 129: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Importinganauto-classificationmodelYoumustcompletethesetasksbeforeyoucanimportanauto-classificationmodel.

BeforeyoubeginDownloadtheclassificationexportutility.Theproceduremustbedoneonlyonetime.PreparetheIBM®ContentClassificationmodelforimport.Thisproceduremustbecompletedforeverymodelyouwanttoimport.

AboutthistaskToimportaclassificationmodel,gototheAuto-classificationtaboftheIBMStoredIQAdministrator.Thetabdisplaysthealreadyimportedmodelsasdescribedinthistable.

Table1.ClassificationmodelcolumnnamesanddescriptionsClassificationmodelcolumn

nameDescription

Classificationmodelname Liststhenameoftheclassificationmodel.

Attributename Liststhenameoftheattributethatisusedbytheclassificationmodel.Status Liststheclassificationmodel'sstatus,specificallyAvailable,orPending.Creationdate Liststhedateandtimeatwhichtheclassificationmodelwascreated.Description Liststhedescriptionoftheclassificationmodel.

Procedure1. WithinIBMStoredIQAdministrator,clickCreateModel.TheCreateModeldialogboxappears.

2. IntheClassificationModelNametextbox,enterauniquenameforthisauto-classificationmodel.

3. IntheAttributeNametextbox,enterauniquenameforthisattribute.TheAttributeNamemustbeuniquewithinauto-classificationsasitcannotbechangedaftertheclassificationmodelisimported.

4. IntheDescriptiontextbox,enteradescriptionofthismodel.5. IntheAuto-ClassificationModelFiletextbox,clickBrowseandselecttheclassificationmodelfilethatyouwanttousewhenyouarecreatingthemodel.Generally,thisfileisacompressedfilethatiscreatedintheclassificationexportutility.ItconsistsofelementsthatarecreatedinIBMContentClassificationbytheDataExpert.

6. ClickSave,andthenewlycreatedmodelappearsinthelistofclassificationmodels.

Parenttopic:Auto-classificationmodels

RelatedconceptsAuto-classificationmodelsDataserversizing-configurationguidelines

IBMUnstructuredData751, p. 120

Page 130: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

SearchingforaspecificclassificationmodelWhenyouhavemultipleclassificationmodelstochoose,youcansearchforaspecificclassificationmodelinsteadofusingtheslidertomovethroughavailableoptions.

Procedure1. IntheEnterkeyterms(s)textbox,enterthenameoftheclassificationmodelforwhichyouwanttosearch,andthenpressSearch.Youcanentereitherthefullclassificationmodelnameoraportionofit.Toremovethesearchterm,clicktheXtotheleftoftheEnterkeyterm(s)textbox.Classificationmodelsthatmatchtheenteredsearchtermarereturned.

2. Edit,clone,ordeletetheclassificationmodelasneeded.

Parenttopic:Auto-classificationmodels

RelatedconceptsAuto-classificationmodelsDataserversizing-configurationguidelines

IBMUnstructuredData751, p. 121

Page 131: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

EditingamodelThetermsandformatsthatareassociatedwithaparticularclassificationmodelchangeovertime,whichmeansthattheclassificationmodelmustalsochange.Classificationmodelscanbeeditedorupdated,modifyingthemodelfilethatisassociatedwiththatparticularclassificationmodel.

Procedure1. OntheListofClassificationModelspageofAuto-classificationtab,clickthenameofthe

classificationmodelthatyouwanttoedit,andthenclickEditModel.TheEditModelwindowappears.

2. Edittheclassificationmodelfieldsasneeded.Note:Attributenamescannotbechanged,butyoucaneditthenameofthemodelwithoutspecifyinganewmodel(.ZIP)file.Ifyouattempttomodifyaclassificationmodelthatisbeingused,awarningappears.ClickOKtoreturntotheListofClassificationModelspage.

3. ClickSavetosaveyourchanges.

Parenttopic:Auto-classificationmodels

RelatedconceptsAuto-classificationmodelsDataserversizing-configurationguidelines

IBMUnstructuredData751, p. 122

Page 132: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DeletingamodelExistingclassificationmodelscanbedeletedfromthelistofavailablemodels,ifitwasnotusedtoenhanceaninfosetandthatinfosetstillexists.

Procedure1. IntheListofClassificationModelspage,selecttheclassificationmodelthatyouwantto

delete,andthenclickDeleteModel.TheDeleteModelwindowappears.2. ClickDeletetodeletetheselectedmodel.Theclassificationmodelisremovedfromthe

ListofClassificationModelspage.Itisnolongeravailableforuse.

Parenttopic:Auto-classificationmodels

RelatedconceptsAuto-classificationmodelsDataserversizing-configurationguidelines

IBMUnstructuredData751, p. 123

Page 133: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ConceptmanagementWithinIBM®StoredIQPlatform,youcanusetheconcept-managementfeaturetorelatebusinessideastoindexeddata.

WhenyouareusingIBMStoredIQAdministrator,youuseinfosets,runactions,generatereports,andmoregenerally,interactwithIBMStoredIQPlatformasawhole.ThesetechnicalaspectsofusingIBMStoredIQAdministratoraredesignedformoretechnicalusers.Conceptsaredesignedforthebusinessuserandprovideauserexperienceofcreatingafilterthatfindsdocumentsthatareownedbyaparticularusername,forexample.Thisuseoftheproductisorientedtowardssolvingbusinessproblems.Usingtheproducttypicallyrequirestheusertotranslatebusinessconceptslikeidentity,department,vendor,andprojectintothevarioustechnicalconceptsoftheproduct,suchasfiltersandinfosets.

Aconceptdefinesandrepresentsanidentity,custodian,vendor,andprojectthatcanberelatedtoindexeddatainameaningfulway.Itisasetofattributesthatdescribeanddistinguishindividualconceptmembers.Forexample,anemployeeconceptmightdefinetheattribute'susername,givenname,surname,andemailaddress.

Conceptmembersarethegranularbuildingblocksofaconcept.Whenconceptmembersaredefined,theycanbegatheredintogroupsforaggregateuse.

TheIdentityconceptiscreatedasapredefined,preconfiguredconceptavailablewithinIBMStoredIQeDiscovery.

TheListofConceptsscreenissimple,depictingconcepts,identities,andaspects.Fromhere,youcansearchfor,delete,edit,andaddidentities.

Table1.ConceptcolumnsanddescriptionsConceptColumn

Name Description

Firstname Liststhegivenname.Lastname Liststhesurname.Emailaddress Liststheemailaddress.OwnerID Liststheowneridentificationnumber.Company Liststhemember'scompanyname.Department Liststhedepartmentofthemember.

AddingamembertoaconceptMemberscanbeaddedtoexistingconcepts.SearchingforaconceptWhenyouhavemultipleconceptsavailabletochoose,youcansearchforaspecificconceptinsteadofusingtheslidertomovethroughavailableoptions.EditingamemberofaconceptExistingconceptsandtheirmemberscanbemodified.DeletingamemberofaconceptExistingconceptmemberscanbedeletedfromthelistofavailableconcepts.

IBMUnstructuredData751, p. 124

Page 134: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

AddingamembertoaconceptMemberscanbeaddedtoexistingconcepts.

Procedure1. ClickConcepts.2. Fromthelist,selectthetypeofconceptyouwouldliketoadd,andthenclickCreate

Member.TheIdentityconceptwascreatedasapredefined,preconfiguredaspect.TheAddIdentitydialogboxappears.

3. IntheAddIdentitydialogbox,completethesefields.a. IntheFirstNametextbox,entertheidentity'sgivenname.b. IntheLastNametextbox,entertheidentity'ssurname.c. IntheE-mailAddresstextbox,entertheidentity'semailaddress.d. IntheCompanytextbox,enterthenameofthecompanythatisassociatedwiththis

identity.e. IntheDepartmenttextbox,enterthenameoftheidentity'sdepartment.f. IntheOwnerIDtextbox,entertheidentity'sownerID.

4. ClickCanceltocanceladdinganidentityandreturntotheListofConceptsscreen,orclickSavetosavetheaddedmemberandreturntotheListofConceptspage.

Parenttopic:Conceptmanagement

RelatedconceptsConceptmanagement

IBMUnstructuredData751, p. 125

Page 135: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

SearchingforaconceptWhenyouhavemultipleconceptsavailabletochoose,youcansearchforaspecificconceptinsteadofusingtheslidertomovethroughavailableoptions.

Procedure1. IntheEnterkeyterms...textbox,enterthenameoftheconceptforwhichyouwantto

search,andthenpressSearch.Youcanentereitherthefullconceptnameoraportionofit.Toremovethesearchterm,clicktheXtotheleftoftheEnterkeyterms....textbox.Conceptsthatmatchtheenteredsearchtermarereturned.

2. Editordeletetheconceptasneeded.

Parenttopic:Conceptmanagement

RelatedconceptsConceptmanagement

IBMUnstructuredData751, p. 126

Page 136: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

EditingamemberofaconceptExistingconceptsandtheirmemberscanbemodified.

Procedure1. FromtheListofConceptpage,selecttheconceptthatyouwanttoedit,andthenclick

Edit.TheIdentityconceptwascreatedasapredefined,preconfiguredaspect.TheEditIdentitydialogboxappears.

2. EdittheconceptmemberandclickOKtosaveyourchanges.

Parenttopic:Conceptmanagement

RelatedconceptsConceptmanagement

IBMUnstructuredData751, p. 127

Page 137: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DeletingamemberofaconceptExistingconceptmemberscanbedeletedfromthelistofavailableconcepts.

AboutthistaskNote:Ifyoudeleteamemberofaconcept,existingfiltersthatusethatconcept'smembersareaffected.

Procedure1. FromtheListConceptspage,selecttheconceptmemberthatyouwanttodelete,and

thenclickDelete.TheDeleteConfirmationwindowappears.2. ClickOKtodeletetheselectedconceptmember.Thememberoftheconceptisremoved

fromthetableandisnolongeravailableforuse.

Parenttopic:Conceptmanagement

RelatedconceptsConceptmanagement

IBMUnstructuredData751, p. 128

Page 138: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

AdministeringIBMStoredIQPlatformDataServerThefollowingtopicsprovideinstructionsonhowtoconductadministrativetaskssuchasadministeringappliance,configuringIBM®StoredIQPlatform,andcreatingvolumesanddatasource.

IBMStoredIQPlatformuserinterfaceThechapterprovidesanintroductiontotheIBMStoredIQPlatformwebinterface.Itoutlinesthefeatureswithineachtabandprovidesreferencestosectionswhereyoucanfindadditionalinformationoneachtopic.SystemadministrationSystemadministrationentailscheckingthesystem'sstatusandrestartingtheappliance.ConfigurationofIBMStoredIQPlatformThissectiondescribestheApplicationandNetworkareasthatanadministratorcanmodifytoconfigureIBMStoredIQPlatform.VolumesanddatasourcesVolumesordatasourcesareintegraltoIBMStoredIQPlatformindexingyourdata.DataharvestingHarvesting(orindexing)istheprocessortaskbywhichIBMStoredIQPlatformexaminesandclassifiesdatainyournetwork.JobconfigurationJobshavedifferentfunctions,anddependingonthejobtypethatischosen,differentsystemoutcomesoccur.Severaljobsthatarereadyforusearealsoincluded.DesktopcollectionWhenyouconfiguredesktopsettings,youareenablingordisablingencryptionwithinIBMStoredIQPlatform.TheIBMDesktopDataCollector(desktopclientorclient)enablesdesktopsasavolumetypeordatasource,allowingthemtobeusedjustasothertypesofaddeddatasources.TheIBMDesktopDataCollectorisprovidedasastandardMSIfileandisinstalledaccordingtothetypicalmethod(suchasMicrosoftSystemsManagementService(SMS))usedwithinyourorganization.TheIBMDesktopDataCollectorcancollectPSTs,compressedfiles,andotherdataobjectsandcanremoveitselfwhenitsworkiscompleted.FoldersThissectionprovidesbothconceptualandproceduralinformationaboutfoldersandtheirusage.AuditsandlogsThefollowingsectiondescribestheauditandlogcategoriesinthesystem,includingdescriptionsofthevariousaudittypesandhowtoviewanddownloaddetails.DeployingcustomizedwebservicesThisprocedurehighlightsthebasicstepsthatarerequiredtodeploySharePointcustomwebservices.SupportedfiletypesThefollowingsectionprovidesacomprehensivelistofthefiletypesthatcanbeharvestedandprocessedbyIBMStoredIQPlatform,organizedbynameandbycategory.YoucanalsoviewSharePointattributes.SupportedserverplatformsandprotocolsThefollowingsectionliststhesupportedserverplatformsbyvolumetypeandtheprotocolsforsupportedsystems.EventlogmessagesThefollowingsectioncontainsacompletelistingofallERROR,INFO,andWARNevent-logmessagesthatappearintheEventLogoftheIBMStoredIQPlatformconsole.

Parenttopic:AdministeringIBMStoredIQ

IBMUnstructuredData751, p. 129

Page 139: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

IBMStoredIQPlatformuserinterfaceThechapterprovidesanintroductiontotheIBM®StoredIQPlatformwebinterface.Itoutlinesthefeatureswithineachtabandprovidesreferencestosectionswhereyoucanfindadditionalinformationoneachtopic.

NavigationwithinIBMStoredIQPlatformTheprimarytabsandsubtabsfoundwithintheuserinterfaceprovideyouwiththeaccesstodataserverfunctionality.WebinterfaceiconsThefollowingtablesdescribetheiconsthatareusedthroughoutIBMStoredIQPlatformwebinterface.

IBMUnstructuredData751, p. 130

Page 140: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

NavigationwithinIBMStoredIQPlatformTheprimarytabsandsubtabsfoundwithintheuserinterfaceprovideyouwiththeaccesstodataserverfunctionality.

PrimaryIBMStoredIQPlatformtabsIBM®StoredIQPlatformusersdomosttaskswiththewebinterface.Themenubaratthetopoftheinterfacecontainsthreeprimarytabsthataredescribedinthistable.

Table1.IBMStoredIQPlatformprimarytabsTabname Description

Administration AllowsAdministratorstodovariousconfigurationsonthesesubtabs:Dashboard,DataSources,andConfiguration.

Folders Createfoldersandjobs;runjobs.

Audit Examinesacomprehensivehistoryofallharvests,runpolicies,imports,andeventlogs.

AdministrationtabTheAdministrationtabincludesthesesubtabs:Dashboard,DataSources,andConfiguration.

Dashboard:TheDashboardsubtabprovidesanoverviewofthesystem'scurrent,ongoing,andpreviousprocessesanditsstatus.Thistabledescribesadministrator-levelfeaturesanddescriptions.Datasources:TheDatasourcessubtabiswhereadministratorsdefineserversandvolumes.Theycanbeplacesthatareindexedorcopiedto.Variousservertypesandvolumescanbeconfiguredforuseinmanagingdata.AdministratorscanaddEnterpriseVaultsites,Centerapools,DellDXStorageClusters,Celerra,NetApp,andFileNetserversthroughtheSpecifyserversarea.VolumesareconfiguredandimportedintheSpecifyvolumessection.Configuration:TheadministratorconfiguressystemandapplicationsettingsforIBMStoredIQPlatformthroughtheConfigurationsubtab.

Table2.DashboardsubtabsettingsanddescriptionsDashboardsetting Description

Pagerefresh Choosefrom30-second,60-second,or90-secondintervalstorefreshthepage.

Today'sjobschedule

Viewalistofjobsthatarescheduledforthatdaywithlinkstothejob'ssummary.

Systemsummary

Viewasummaryofsystemdetails,includingsystemdataobjects,containeddataobjects,volumes,andthedatesofthelastcompletedharvest.

Jobsinprogress

Viewdetailsofeachjobstepasitisrunning,includingestimatedtimetocompletion,averagespeed,totalsystemandcontainedobjectsthatareencountered,harvestexceptions,andbinaryprocessinginformation.

Harveststatistics Reviewtheperformanceoverthelasthourforallharvests.

Eventlog Reviewthelast500eventsordownloadtheentireeventlogforthecurrentdateorpreviousdates.

Appliancestatus

Providesastatusviewoftheappliance.Restarttheappliancethroughtheaboutappliancelink.Viewcachedetailsforvolumesanddiscoveryexports.

Table3.ConfigurationsettingsanddescriptionsConfigurationsetting

Description

DAGatewaysettings:ConfiguretheDAGatewayhostorIPaddress.

IBMUnstructuredData751, p. 131

Page 141: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

System

DAGatewaysettings:ConfiguretheDAGatewayhostorIPaddress.Networksettings:Configuretheprivateandpublicnetworkinterfaces.Mailserversettings:Configurewhatmailservertouseandhowoftentosendemail.SNMPsettings:ConfigureSimpleNetworkManagementProtocol(SNMP)serversandcommunities.Systemtimeanddate:Setthesystemtimeanddateontheappliance.Manageusers:Add,remove,andeditusers.LotusNotesuseradministration:AddaLotusNotesUser.

Application

Harvestersettings:Setbasicparametersandlimits,dataobjectextensionsanddirectoriestoskip,andreasonstorunbinaryprocessing.Full-textsettings:Setfull-textsearchlimitsforlengthofwordandnumbersandeditstopwords.Dataobjecttypes:Settheobjecttypesthatappearinthediskusebydataobjecttypereport.Auditsettings:Configurehowlongandhowmanyauditsarekept.Hashsettings:Configurewhethertocomputeahashwhenharvestingandwhichhash.Desktopsettings:Configurethedesktopcollectionservice.

FolderstabWithintheFolderstab,anytypeofusercancreateandmanageapplicationobjects.

AudittabIBMStoredIQPlatformauditfeatureallowsAdministratorstoreviewallactionsthataretakenwiththedataserver,includingreviewingharvestsandexaminingtheresultsofactions.

Parenttopic:IBMStoredIQPlatformuserinterface

RelatedconceptsIBMStoredIQPlatformuserinterface

IBMUnstructuredData751, p. 132

Page 142: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

WebinterfaceiconsThefollowingtablesdescribetheiconsthatareusedthroughoutIBM®StoredIQPlatformwebinterface.

IBMStoredIQPlatformiconsTable1.IBMStoredIQPlatformdashboardicons

Dashboardicon Description

UseraccountTheUseraccounticonaccessesyouruseraccount,providesinformationaboutversionandsystemtimes,andlogsyououtofthesystem.Formoreinformation,seeLoggingInandOutoftheSystem.

Inbox TheinboxlinkprovidesyoutheaccesstothePDFauditreports.

HelpClickingtheHelpiconloadsIBMStoredIQPlatformtechnicaldocumentationinaseparatebrowserwindow.Bydefault,thetechnicaldocumentationisloadedasHTMLhelp.

FoldersiconsTable2.IBMStoredIQPlatformFoldersicons

Foldericon DescriptionNew UsetheNewicontoaddjobsandfolders.

Action UsetheActionicontoactonworkspaceobjects,includingtheabilitytomove,anddeletejobsandfolders.

Job Jobstaskssuchasharvestingareeitherasteporaseriesofsteps.Formoreinformation,seeJobconfiguration.

Folder Foldersareacontainerobjectthatcanbeaccessedandusedbyadministrators.Formoreinformation,seeFolders.

FolderUpFoldersareacontainerobjectthatcanbeaccessedandusedbyadministrators.Bydefault,youviewthecontentsoftheWorkspacefolder;however,byclickingthisicon,youmovetotheparentfolderinthestructure.Formoreinformation,seeUsingFolders.

AuditiconsNospecializediconsareusedontheAudittab.

Parenttopic:IBMStoredIQPlatformuserinterface

RelatedconceptsIBMStoredIQPlatformuserinterface

IBMUnstructuredData751, p. 133

Page 143: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

SystemadministrationSystemadministrationentailscheckingthesystem'sstatusandrestartingtheappliance.

Checkingthesystem'sstatusYoucancheckthesystem'sstatusforinformationaboutvariousappliancedetails.RestartingthesystemRestartingthesystemmustbedoneperiodically.

IBMUnstructuredData751, p. 134

Page 144: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Checkingthesystem'sstatusYoucancheckthesystem'sstatusforinformationaboutvariousappliancedetails.

Procedure1. GotoAdministration>Dashboard>Appliancestatus.2. ClickAboutappliancetoopentheAppliancedetailspage.TheAppliancedetailspage

showsthefollowinginformation:NodeHarvesterprocessesStatusSoftwareversionViewdetailslink

3. ClicktheViewdetailslinkforthecontroller.Thefollowingtabledefinesappliancedetailsanddescribesthedatathatisprovidedforthenode.Option DescriptionViewappliancedetails

Showssoftwareversionanddetailsofharvesterprocessesrunningonthecontrollerfortheappliance.

Applicationservices

Showsalistofallservicesandstatus,whichincludesthisinformation:Service:thenameofeachserviceontheappliancecomponentPID:theprocessIDassociatedwitheachserviceCurrentmemory(MB):thememorythatisbeingusedbyeachserviceTotalmemory(MB):totalmemorythatisbeingusedbyeachserviceandallchildservicesProcessorpercentage:thepercentageofprocessorusageforeachservice.Thisvalueiszerowhenaserviceisidle.Status:thestatusofeachservice.StatusmessagesincludeRunning,Stopped,Error,Initializing,Unknown.

Systemservices

Showsalistofbasicsysteminformationdetailsandmemoryusagestatistics.Systeminformationincludesthisinformation:

Systemtime:currenttimeontheappliancecomponentGMTOffset:theamountofvariancebetweenthesystemtimeandGMT.Timeup:thetimetheappliancecomponentwasrunningsincethelastrestart,indays,hours,minutes,andsecondsSystemprocesses:thetotalnumberofprocessesthatarerunningonthenodeNumberofprocessors:thenumberofprocessorsinuseonthecomponentLoadAverage(1Minute):theaverageloadforsystemprocessesduringa1-minuteintervalLoadAverage(5Minutes):theaverageloadforsystemprocessesduringa5-minuteintervalLoadAverage(10Minutes):theaverageloadforsystemprocessesduringa10-minuteinterval

Memorydetailsincludethisinformation:Total:totalphysicalmemoryontheappliancecomponentInuse:howmuchphysicalmemoryisinuseFree:howmuchphysicalmemoryisfreeCached:amountofmemorythatisallocatedtodiskcacheBuffered:theamountofphysicalmemorythatisusedforfilebuffersSwaptotal:thetotalamountofswapspaceavailable(inuseplusfree)SystemservicesSwapinuse:thetotalamountofswapspacethatisused

IBMUnstructuredData751, p. 135

Page 145: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

usedSwapfree:thetotalamountofswapspacefreeDatabaseConnectionsConfiguredActiveIdleNetworkinterfacesUpordownstatusforeachinterface

Storage

Storageinformationforacontrollerincludesthisinformation:VolumeTotalspaceUsedspacePercentage

Controllerandcomputenodestatus

IndicatorlightsshowcomponentstatusGreenlight:RunningYellowlight:Thenodeisfunctionalbutisintheprocessofrebuilding;performancecanbedegradedduringthistime.Note:Therebuildprogressesfasterifthesystemisnotbeingused.Redlight:notrunning

Expandthenodetoobtaindetailsoftheappliancecomponentbyclickingtheimage.

Parenttopic:Systemadministration

RelatedconceptsSystemadministration

IBMUnstructuredData751, p. 136

Page 146: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

RestartingthesystemRestartingthesystemmustbedoneperiodically.

AboutthistaskNote:Thewebapplicationistemporarilyunavailableifyourestartit.Additionally,whenevervolumedefinitionsareeditedormodified,youmustrestartthesystem.

Procedure1. SelectAdministration>Dashboard>Appliancestatus.OntheAppliancestatuspage,youhavetwooptions:

ClicktheControllerlink.ClickAboutAppliance.

2. TheRestartservicesandRebooticonsappearatthebottomofthewindow.TheseiconsareavailableontheViewdetailspageandoneachofthetabs.Clickeitheroftheseoptions:

Restartservices:Restartallsystemservicesthatarerunningonthenode.Reboot:torestartthecomponents.

Parenttopic:Systemadministration

RelatedconceptsSystemadministration

IBMUnstructuredData751, p. 137

Page 147: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ConfigurationofIBMStoredIQPlatformThissectiondescribestheApplicationandNetworkareasthatanadministratorcanmodifytoconfigureIBM®StoredIQPlatform.

TheConfigurationsubtab(Administration>Configuration)isdividedintoSystemandApplicationsections.

Table1.SystemandApplicationconfigurationoptionsSection Configurationoptions

System

ConfiguretheDAgateway.Viewandmodifynetworksettings,includinghostname,IPaddress,NISdomainmembership,anduse.Viewandmodifysettingstoenablethegenerationofemailnotificationmessages.ConfigureSNMPserversandcommunities.Managenotificationsforsystemandapplicationevents.ViewandmodifydateandtimesettingsforIBMStoredIQPlatform.Setbackupconfigurations.Manageusers.UploadLotusNotesuserIDssothatencryptedNSFfilescanbeimportedintoIBMStoredIQPlatform.

Application

Specifydirectorypatternstoexcludeduringharvests.Specifyoptionsforfull-textindexing.View,add,andeditknowndataobjecttypes.Viewandeditsettingsforpolicyauditexpirationandremoval.Specifyoptionsforcomputinghashsettingswhenharvesting.Specifyoptionstoconfigurethedesktopcollectionservice.

ConfiguringDAGatewaysettingsTheDAGatewaysettingsareconfiguredaspartofgeneralsystem-configurationoptions.ConfiguringnetworksettingsConfiguringmailsettingsMailsettingscanbeconfiguredaspartofsystemconfigurationoptions.ConfiguringSNMPsettingsYoucanconfigurethesystemtomakeObjectIdentifier(OID)valuesavailabletoSimpleNetworkManagementProtocol(SNMP)clientapplications.Atthesametime,youcanreceivestatusinformationormessagesaboutsystemeventsinadesignatedtrap.ForinformationaboutenvironmentalcircumstancesthataremonitoredbyIBMStoredIQPlatform,seethefollowingtable.ConfiguringnotificationfromIBMStoredIQPlatformYoucanconfigurethesystemtonotifyyouusingemailorSNMPwhencertaineventsoccur.SettingthesystemtimeanddateThesystem'stimeanddatecanbemodifiedasneeded.SettingsystembackupconfigurationsTopreparefordisasterrecovery,youcanbackuptheconfigurationofadataservertoagateway.Itbacksupvolumedefinitions,discoveryexportrecords,anddata-serversettings.Itdoesnotbackupinfosets,datamaps,orindexes.UsermanagementUsermanagementisdonebythoseusersintheadministratorrole.ImportingencryptedNSFfilesfromLotusNotesIBMStoredIQPlatformcandecrypt,import,andprocessencryptedNSFfilesfromIBMLotusDominov7.Thefeatureworksbycomparingalistofuser.idandkeypairsthatwereimportedintothesystemwiththekeyvaluesthatlockeachencryptedcontaineroremail.Whenthecorrectmatchisfound,thefileisunlockedwiththekey.Aftertheemails

IBMUnstructuredData751, p. 138

Page 148: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

orcontainersareunlocked,IBMStoredIQPlatformanalyzesandprocessesthemintheusualfashion.ThistopicprovidesproceduralinformationabouthowtoimportencryptedNSFfilesfromIBMLotusDomino.ConfiguringharvestersettingsYoucanuseseveraldifferentharvestersettingstofine-tuneyourindexprocess.Configuringfull-textindexsettingsUsethefull-textindexsettingsfeaturetocustomizeyourfull-textindex.SpecifyingdataobjecttypesOntheDataobjecttypespage,youcanaddnewdataobjecttypesandviewandeditknowndataobjecttypes.ThesedataobjectsappearintheDiskusage(bydataobjecttype)report.Currently,thereareover400dataobjecttypesavailable.ConfiguringauditsettingsAuditsettingscanbeconfiguredtodeterminethenumberofdaysandnumberofpolicyauditstobekeptbeforetheyaredeleted.ConfiguringhashsettingsUsetheHashSettingspagetoconfigurewhethertocomputeahashwhenharvesting.Thepageprovidesdifferenttypesofhashes.ConfiguringdesktopsettingsWhenyouconfiguredesktopsettings,youareenablingordisablingencryptionwithinIBMStoredIQPlatform.IBMDesktopDataCollector(desktopclientorclient)enablesdesktopsasavolumetypeordatasource,allowingthemtobeusedjustasothertypesofaddeddatasources.TheclientisprovidedasastandardMSIfile,andisinstalledaccordingtothetypicalmethod(suchasMicrosoftSystemsManagementService(SMS))usedwithinyourorganization.TheclientcancollectPSTsandcompressedfilesandotherdataobjectsanditiscapableofremovingitselfwhenitsworkiscompleted.DownloadingtheIBMDesktopDataCollectorinstallerfromtheapplicationTheIBMDesktopDataCollectorinstallercanbedownloadedfromtheapplication.UpgradingtheIBMDesktopDataCollectoragentTheIBMDesktopDataCollectoragentmustbeupgradedtoopenandharvestencryptedfiles.ManagingtheEncryptedfilesystemrecoveryagentDuringIBMDesktopDataCollectorcollection,ifIBMDesktopDataCollectorfindsanEncryptedFileSystem-encryptedfile,theIBMDesktopDataCollectorinstallsarecoveryagentcertificatesothatyoucanopentheencryptedfile.

RelatedtasksImportingencryptedNSFfilesfromLotusNotes

IBMUnstructuredData751, p. 139

Page 149: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ConfiguringDAGatewaysettingsTheDAGatewaysettingsareconfiguredaspartofgeneralsystem-configurationoptions.

Procedure1. GotoAdministration>Configuration>System>DAGatewaySettings.2. IntheHosttextbox,enterthegatewayhost.Forexample,entermgmt.example.comor

192.168.10.10.3. ClickOK.Servicesmustberestarted.

Parenttopic:ConfigurationofIBMStoredIQPlatform

RelatedconceptsConfigurationofIBMStoredIQPlatformUsermanagement

IBMUnstructuredData751, p. 140

Page 150: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Configuringnetworksettings

Procedure1. GotoAdministration>Configuration>System>Networksettings.2. ClickControllerSettings.SetormodifythefollowingPrimaryNetworkInterfaceoptions.

IPtype:Settosticordynamic.Ifitissettodynamic,theIPaddress,Netmask,andDefaultGatewayfieldsaredisabled.IPaddress:EntertheIPaddress.Netmask:EnterthenetworkmaskoftheIPaddress.Defaultgateway:EntertheIPaddressofthedefaultgateway.Hostname:Enterthefullyqualifieddomainnamethatisassignedtotheappliance.Ethernetspeed:SelecttheEthernetspeed.Availableports:Indicatetheavailableports.Separatenetworkforfile/emailservers:Specifytheadditionalsubnetforaccessingfile/emailservers.Selectthischeckboxifyouareusingthewebapplicationfromonesubnetandharvestingfromanothersubnet.

Restartthesystemforanyprimarynetworkinterfacechangestotakeeffect.SeeRestartingandRebootingtheAppliance.

3. InControllerSettings,setormodifythefollowingDNSSettingsoptions.DNSsearchorder:EntertheDNSsearchorderformultipleDNSservers.Nameserver1:SettheIPaddressoftheprimaryDNSserverfornameresolution.Nameserver2:SettheIPaddressofthesecondaryDNSserverfornameresolution.Nameserver3:SettheIPaddressofthetertiaryDNSserverfornameresolution.

DNSsettingstakeeffectaftertheyaresaved.Changestotheserver'sIPaddresstakeeffectimmediately.BecausetheserverhasanewIPaddress,youmustreflectthisnewaddressinthebrowseraddresslinebeforenextstep.

4. ClickOK.5. ClickServernameresolution.Setthefollowingforthedataserver:

a. WindowsShare(CIFS)fileservernameresolution:Thesesettingstakeeffectuponsaving.

LMHOSTS:EntertheIPhostnameformat.WINSServer:EnterthenameoftheWINSserver.

b. NIS(forNFS):Thesesettingstakeeffectuponsaving.UseNIS:SelectthisboxtoenableNIStoperformUID/GIDtofriendlynameresolutioninanNFSenvironment.NISDomain:SpecifytheNISdomain.Broadcastforserveronlocalnetwork:SelectthisboxiftheNISdomainserverisonthelocalnetworkandcanbediscoveredbybroadcasting.ThisoptiondoesnotworkiftheNISdomainserverisonanothersubnet.SpecifyNISserver:Ifnotusingbroadcast,specifytheIPaddressoftheNISdomainserverhere.

c. ActiveDirectory:Thesesettingstakeeffectuponsaving.ActiveDirectoryserver:EnterthenameoftheActiveDirectoryserver.

d. Docbrokersettings(forDocumentum)EnterHostnamefordocbroker.Documentumglobalregistry:

RegistrynameUserPassword

6. ClickOK.

Parenttopic:ConfigurationofIBMStoredIQPlatform

RelatedconceptsConfigurationofIBMStoredIQPlatformUsermanagement

IBMUnstructuredData751, p. 141

Page 151: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ConfiguringmailsettingsMailsettingscanbeconfiguredaspartofsystemconfigurationoptions.

Procedure1. GotoAdministration>Configuration>System>MailServersettings.2. InMailserver,enterthenameoftheSMTPmailserver.3. InFromaddress,enteravalidsenderaddress.Ifthesenderisinvalid,somemailservers

rejectemail.Asenderaddressalsosimplifiestheprocessoffilteringemailnotificationsthatarebasedonthesender'semail.

4. ClickOKtosavechanges.

Parenttopic:ConfigurationofIBMStoredIQPlatform

RelatedconceptsConfigurationofIBMStoredIQPlatformUsermanagement

IBMUnstructuredData751, p. 142

Page 152: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ConfiguringSNMPsettingsYoucanconfigurethesystemtomakeObjectIdentifier(OID)valuesavailabletoSimpleNetworkManagementProtocol(SNMP)clientapplications.Atthesametime,youcanreceivestatusinformationormessagesaboutsystemeventsinadesignatedtrap.ForinformationaboutenvironmentalcircumstancesthataremonitoredbyIBM®StoredIQPlatform,seethefollowingtable.

Procedure1. GotoAdministration>Configuration>System>SNMPsettings.2. TomakeOIDvaluesavailabletoSNMPclientapplications,intheAppliancePublicMIBarea:a. SelecttheEnabledcheckboxtomaketheMIBavailable,thatis,toopenport161onthecontroller.

b. IntheCommunityfield,enterthecommunitystringthattheSNMPclientsusetoconnecttotheSNMPserver.

c. ToviewtheMIB,clickDownloadApplianceMIB.ThisdocumentprovidestheMIBdefinition,whichcanbeprovidedtoanSNMPclientapplication.

3. TocapturemessagesthatcontainstatusinformationintheTrapdestinationarea:a. IntheHostfield,enterthecommonnameorIPaddressforthehost.b. InthePortfield,entertheportnumber.Portnumber162isthedefault.c. IntheCommunityfield,entertheSNMPcommunityname.

4. Tomodifythefrequencyofnotifications,completethesefieldsintheEnvironmentaltrapdeliveryarea:a. Sendenvironmentaltrapsonlyevery__minutes.b. Sendenvironmentaltrapsagainafter__minutes.

5. ClickOK.EnvironmentaltrapsthataremonitoredbyIBMStoredIQPlatformaredescribedinthistable.Option DescriptionsiqConsoleLogLineTrap

Astraightconversionofaconsoleloglineintoatrap.Itusestheseparameters:messageSource,messageID,severity,messageText.

siqRaidControllerTrap

SentwhentheRAIDcontrollerstatusisanythingbutnormal.RefertotheMIBforstatuscodeinformation.Itusesthisparameter:nodeNum.

siqRaidDiskTrap

Sentwhenanyattachedraiddisk'sstatusisanythingbutOK.Itusesthisparameter:nodeNum.

siqBbuTrap BatteryBackupUnit(BBU)errorontheRAIDcontrollerdetected.Itusesthisparameter:nodeNum.

siqCacheBitTrap CachingindicatorforRAIDarrayisoff.Itusesthisparameter:nodeNum.

siqNetworkTrap

NetworkinterfaceisnotUPwhenitmustbe.Itusesthisparameter:nodeNum.

siqDbConnTrap

DeliveredwhentheactivePostgresconnectionpercentageexceedsanacceptablethreshold.Itusesthisparameter:nodeNum.

siqFreeMemTrap

Deliveredwhenavailablememoryfallstoolow.Itusesthisparameter:nodeNum.

siqSwapUseTrap

Sentwhenswapuseexceedsanacceptablethreshold.Oftenindicatesmemoryleakage.Itusesthisparameter:nodeNum.

siqCpuTrap Sentwhenprocessorloadaveragesaretoohigh.Itusesthisparameter:nodeNum.

siqTzMismatchTrap

Sentwhenthetimezoneoffsetofanodedoesnotmatchthetimezoneoffsetofthecontroller.Itusesthisparameter:nodeNum.

Parenttopic:ConfigurationofIBMStoredIQPlatform

IBMUnstructuredData751, p. 143

Page 153: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

RelatedconceptsConfigurationofIBMStoredIQPlatformUsermanagement

IBMUnstructuredData751, p. 144

Page 154: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ConfiguringnotificationfromIBMStoredIQPlatformYoucanconfigurethesystemtonotifyyouusingemailorSNMPwhencertaineventsoccur.

AboutthistaskForalistofeventsthatcanbeconfigured,seeEventlogmessages.

Procedure1. GotoAdministration>Configuration>System>Managenotifications.2. ClickCreateanotification.3. IntheEventnumber:field,searchforeventsbyclickingBrowseorbytypingtheeventnumberorsamplemessageintothefield.

4. SelecttheeventlevelbyclickingtheERROR,WARN,orINFOlink.5. Scrollthroughthelist,andselecteacheventbyclickingit.Theselectedeventsappearinthecreatenotificationwindow.Todeleteanevent,clickthedeleteicontotherightoftheevent.

6. IntheDestination:field,selectthemethodofnotification:SNMP,orEmailaddress,orboth.Ifyouchooseemailaddress,enteroneormoreaddressesintheEmailaddressfield.IfyouchooseSNMP,themessagesaresenttothetraphostidentifiedintheSNMPsettingswindow,withatraptypeofsiqConsoleLogLineTrap.

7. ClickOK.8. TodeleteanitemfromtheManagenotificationswindow,selectthecheckboxnexttotheevent,andthenclickDelete.Youcanalsorequestanotificationforaspecificeventfromthedashboard’seventlog.ClicktheSubscribelinknexttoanyerrormessageandaprepopulatededitnotificationscreenthatcontainstheeventisprovided.

Parenttopic:ConfigurationofIBMStoredIQPlatform

RelatedconceptsConfigurationofIBMStoredIQPlatformUsermanagement

IBMUnstructuredData751, p. 145

Page 155: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

SettingthesystemtimeanddateThesystem'stimeanddatecanbemodifiedasneeded.

AboutthistaskNote:Asystemrestartisrequiredforanychangesthataremadetothesystemtimeanddate.SeeRestartingandRebootingtheAppliance.

Procedure1. GotoAdministration>Configuration>System>Systemtimeanddate.2. Enterthecurrentdateandtime.3. Selecttheappropriatetimezoneforyourlocation.4. EnableUseNTPtosetsystemtimetouseanNTPservertoautomaticallysetthesystemdateandtimeforthedataserver.IfNTPisusedtosetthesystemtime,thenthetimeanddatefieldssetautomatically.However,youmustspecifythetimezone.

5. EnterthenameorIPaddressoftheNTPserver.6. ClickOKtosavechanges.

Parenttopic:ConfigurationofIBMStoredIQPlatform

RelatedconceptsConfigurationofIBMStoredIQPlatformUsermanagement

IBMUnstructuredData751, p. 146

Page 156: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

SettingsystembackupconfigurationsTopreparefordisasterrecovery,youcanbackuptheconfigurationofadataservertoagateway.Itbacksupvolumedefinitions,discoveryexportrecords,anddata-serversettings.Itdoesnotbackupinfosets,datamaps,orindexes.

BeforeyoubeginThegatewaymustbemanuallyconfiguredtosupportthisbackup.Foradditionalinformation,configurethegatewayintheutilmenu.Itcanbedonebycontactingyourservicerepresentative.

Procedure1. GotoAdministration>Configuration>System>Backupconfiguration.2. PressStartbackup.

Parenttopic:ConfigurationofIBMStoredIQPlatform

RelatedconceptsConfigurationofIBMStoredIQPlatformUsermanagement

IBMUnstructuredData751, p. 147

Page 157: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

UsermanagementUsermanagementisdonebythoseusersintheadministratorrole.

Usermanagemententailslogginginandoutofthesystemandvariousaccount-administrationtasks.

LogginginandoutofthesystemThesystemcomeswithadefaultadministrativeaccountnamedadmin,thedefaultpasswordforwhichisadmin.Forsecuritypurposes,changethepasswordassoonaspossible.ChangingtheadministrativeaccountTheadministratoraccountanditspasswordcanbechangedbyanadministrator.CreatingusersUserscanbeaddedonlybyadministrators.EditingusersUseraccountscanbeeditedbyadministrators.Deletingauser'saccountUseraccountscanbedeletedbyadministrators.Lockingauser'saccountUseraccountscanbelockedbyanadministrator.Managingauser'saccountAspartofbasicuseraccountadministration,useraccountscanbeunlocked.

Parenttopic:ConfigurationofIBMStoredIQPlatform

RelatedconceptsConfigurationofIBMStoredIQPlatform

RelatedtasksConfiguringDAGatewaysettingsConfiguringnetworksettingsConfiguringmailsettingsConfiguringSNMPsettingsConfiguringnotificationfromIBMStoredIQPlatformSettingthesystemtimeanddateSettingsystembackupconfigurationsLogginginandoutofthesystemChangingtheadministrativeaccountCreatingusersEditingusersDeletingauser'saccountLockingauser'saccountManagingauser'saccount

IBMUnstructuredData751, p. 148

Page 158: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

LogginginandoutofthesystemThesystemcomeswithadefaultadministrativeaccountnamedadmin,thedefaultpasswordforwhichisadmin.Forsecuritypurposes,changethepasswordassoonaspossible.

Procedure1. Openabrowserandintheaddressline,entertheURLforyoursystem.2. OntheLoginpage,enteradminfortheemailaddressandadminforthepasswordthefirst

timeyoulogin.3. ClickLogIntoenterthesystem.

Note:DatabaseCompactor:Ifsomeonetriestologinwhiletheapplianceisdoingdatabasemaintenance,theadministratorcanoverridethemaintenanceprocedureandusethesystem.Formoreinformation,seeJobconfiguration.

4. Tologoutoftheapplication,clickUserAccountintheupperrightcorner,andthenclicktheLogoutlink.

Parenttopic:Usermanagement

RelatedconceptsUsermanagement

IBMUnstructuredData751, p. 149

Page 159: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ChangingtheadministrativeaccountTheadministratoraccountanditspasswordcanbechangedbyanadministrator.

Procedure1. OntheAdministration>Configurationtab,clickManageusers.2. Fromthelist,selectTheAdministratoraccount,andthenselectChangethe“admin”

password.3. Enteranewpassword,andthenclickOKtosavethechange.

Parenttopic:Usermanagement

RelatedconceptsUsermanagement

IBMUnstructuredData751, p. 150

Page 160: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

CreatingusersUserscanbeaddedonlybyadministrators.

Procedure1. GotoAdministration>Configuration>Manageusers,andthenclickCreatenewuser.2. IntheFirstnamefield,entertheuser'sgivenname.3. IntheLastnamefield,entertheuser'ssurname.4. IntheEmailaddressfield,entertheuser'semailaddress.5. ForAuthentication,selectActiveDirectoryorLocal.6. IntheActiveDirectoryprincipal,enterthenameoftheActiveDirectoryprincipal.7. ToreceiveNotificationofreportsbyemail,selecteitherYesorNo.8. SelectAdministratorandselecttheRole.9. SelecttheViewdataobjectsintheviewercheckboxifyouwanttoseedataobjectsin

theviewer.10. ClickOKtocreatetheuser.

Parenttopic:Usermanagement

RelatedconceptsUsermanagement

IBMUnstructuredData751, p. 151

Page 161: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

EditingusersUseraccountscanbeeditedbyadministrators.

Procedure1. GotoAdministration>Configuration>Manageusers,andthenclickthenameofthe

userthatyouwanttoedit.2. ClickEditUserandeditthefieldsasneeded.3. ClickOKtosaveyourchanges.

Parenttopic:Usermanagement

RelatedconceptsUsermanagement

IBMUnstructuredData751, p. 152

Page 162: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Deletingauser'saccountUseraccountscanbedeletedbyadministrators.

Procedure1. GotoAdministration>Configuration>Manageusers,andthenclickthenameoftheuserthatyouwanttodelete.

2. ClickDelete,andthenclickOK.

Parenttopic:Usermanagement

RelatedconceptsUsermanagement

IBMUnstructuredData751, p. 153

Page 163: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Lockingauser'saccountUseraccountscanbelockedbyanadministrator.

Procedure1. OntheAdministration>Configurationpage,clickManageusers.2. Inthelist,selecttheusernameoftheaccountyouwanttolock.3. ClickLockuseraccounttodisabletheaccount.Apadlockiconappearsnexttothe

accountnameinthelist,indicatingthattheaccountisnowlocked.Theusercannotlogintotheaccountwhileitislocked.

Parenttopic:Usermanagement

RelatedconceptsUsermanagement

IBMUnstructuredData751, p. 154

Page 164: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Managingauser'saccountAspartofbasicuseraccountadministration,useraccountscanbeunlocked.

Procedure1. OntheAdministration>Configurationpage,clickManageusers.2. Inthelist,selecttheusernameoftheaccountyouwanttounlock.3. ClickUnlockaccounttore-enabletheaccount.

Parenttopic:Usermanagement

RelatedconceptsUsermanagement

IBMUnstructuredData751, p. 155

Page 165: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ImportingencryptedNSFfilesfromLotusNotesIBM®StoredIQPlatformcandecrypt,import,andprocessencryptedNSFfilesfromIBMLotusDominov7.Thefeatureworksbycomparingalistofuser.idandkeypairsthatwereimportedintothesystemwiththekeyvaluesthatlockeachencryptedcontaineroremail.Whenthecorrectmatchisfound,thefileisunlockedwiththekey.Aftertheemailsorcontainersareunlocked,IBMStoredIQPlatformanalyzesandprocessesthemintheusualfashion.ThistopicprovidesproceduralinformationabouthowtoimportencryptedNSFfilesfromIBMLotusDomino.

AboutthistaskTheseusecasesaresupported:

Multipleunencryptedemailswithinajournalingdatabasethatwasencryptedwithasingleuser.idkeyMultipleunencryptedemailsinanencryptedNSFfileMultipleencryptedemailswithinanunencryptedNSFfileMultipleencryptedemailswiththesameordifferentuser.idkeys,containedinanencryptedNSFfileEncryptedemailsfromwithinajournalingdatabase

Procedure1. Ontheprimarydataserver,gotoAdministration>Configuration>LotusNotesuser

administration.2. ClickUploadaLotususerIDfile.

a. Inthedialogthatappears,clickBrowse,andgotoauserfile.b. IntheLotusNotespassword:field,typethepasswordthatunlockstheselectedfile.c. Optional:IntheDescription:field,enteradescriptionforthefile.d. ClickOK.Repeatuntilthekeysforallencrypteditemsareuploaded.Whenthelist

iscompiled,youcanaddnewentriestoitthen.e. Todeleteanitemfromthelist,fromtheRegisteredLotususersscreen,selectthe

checkboxnexttoauser,andthenclickDelete.Intheconfirmationdialogthatappears,clickOK.Note:AfteryouuploaduserIDs,restartservices.

Parenttopic:ConfigurationofIBMStoredIQPlatform

RelatedconceptsConfigurationofIBMStoredIQPlatform

IBMUnstructuredData751, p. 156

Page 166: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ConfiguringharvestersettingsYoucanuseseveraldifferentharvestersettingstofine-tuneyourindexprocess.

Procedure1. GotoAdministration>Configuration>Application>Harvestersettings.2. ToconfigureBasicsettings:

a. HarvesterProcesses:SelecteitherContentprocessingorSystemmetadataonly.b. Harvestmiscellaneousemailitems:Selecttoharvestcontacts,calendar

appointments,notes,andtasksfromtheExchangeserver.c. Harvestnon-standardExchangemessageclasses:Selecttoharvestmessageclasses

thatdonotrepresentstandardExchangeemailandmiscellaneousitems.d. Includeextendedcharactersinobjectnames:Selecttoallowextendedcharactersto

beincludedindataobjectnamesduringaharvest.e. DeterminewhetherdataobjectshaveNSRLdigitalsignature:Selecttocheckdata

objectsforNSRLdigitalsignatures.f. Enableparallelgrazing:Selecttoharvestvolumesthatwerealreadyharvestedandaregoingtobereharvested.Iftheharvestcompletesnormally,parallelizedgrazingenablesharveststobeginwheretheyleftoffwheninterruptedandtostartatthebeginning.

g. EnableOCRimageprocessing:SelectthisoptiontocontrolatagloballevelwhetherOpticalCharacterRecognition(OCR)processingisattemptedonimagefiles.Ifyouselectthisoption,youmustrestartservices.SeeRestartingandRebootingtheAppliance.

3. SpecifySkipContentprocessing.Dataobjectextensionstobeskipped:Specifythosefiletypesthatyouwanttheharvesttoignorebyaddingdataobjectextensionstobeskipped.

4. ToconfigureLocationstoignore,entereachdirectorythatmustbeskipped.IBM®StoredIQPlatformacceptsonlyoneentryperlineandthatregularexpressionscanbeused.

5. ToconfigureLimits:a. Maximumdataobjectsize:Specifythemaximumdataobjectsizetobeprocessed

duringaharvest.Duringaharvest,ilesexceedingthemaximumdataobjectsizeisnotread.Asaresult,iffull-text/contentprocessingisenabledforthevolume,theyareauditedasskipped:Configuredmax.objectsize.Theseobjectsstillappearinthevolumeclusteralongwithallfilesystemmetadata.Sincetheywerenotread,thehashisahashofthefile-pathandsizeoftheobject,regardlessofwhatthehashsettingsareforthevolume(full/partial/off).

b. Maxentityvaluesperentity:Foranyentitytype(date,city,addressandthelike),thesystemrecords,perdataobject,thenumberofvaluessetinthisfield.Thevaluesdonotneedtobeunique.Forexample,ifthemaximumvalueis1,000,andtheharvestercollects1,000instancesofthesamedate(8/15/2009)inaWorddocument,thesystemstopscountingdates.Thissettingappliestoalluser-definedexpressions(keyword,regularexpression,scoped,andproximity)andallstandardattributes.

c. Maxentityvaluesperdataobject:Acrossallentitytypes,thetotal(cumulative)numberofvaluesthatiscollectedfromadataobjectduringaharvest.A0inthisfieldmeans"unlimited".Thissettingappliestoalluser-definedexpressions(key-word,regularexpression,scoped,andproximity)andallstandardattributes.

6. ConfigureBinaryProcessing.a. Runbinaryprocessingwhentextprocessingfails:Selectthisoptiontorunbinary

processing.Thesystemrunsfurtherprocessesagainstcontentthatfailedintheharvesting.Youcanselectoptionsforwhentostartthisextendedprocessingandhowtoscancontent.Binaryprocessingdoesnotsearchimagefiletypessuchas.GIFand.JPGfortextextraction.

b. Failurereasonstobeginbinaryprocessing:Selectthecheckboxesoftheoptionsthatdefinewhentostartextendedprocessing.Binaryprocessingcanenactinextractingtextfromafilefailureinthesesituations:

IBMUnstructuredData751, p. 157

Page 167: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

WhentheformatofthefileisunknowntothesystemparametersWhenthedataobjecttypeisnotsupportedbytheharvesterscanWhenthedataobjectformatdoesnotcontainactualtext

c. Dataobjectextensions:Setbinaryprocessingtoprocessalldatafilesoronlyfilesofenteredextensions.Toaddextensions,enteroneperlinewithoutaperiod.

d. Textencoding:Setoptionsforwhatdatatoscanandextractatthestartofbinaryprocessing.ThisextendedprocessingcanacceptextendedcharactersandUTF-16andUTF-32encodedcharactersastext.ThesystemsearchesUTF-16andUTF-32bydefault.

e. Minimums:Settheminimumrequirednumberoflocated,consecutivecharacterstobeginprocessingfortextextraction.Forexample,ifyouenter4,thesystembeginstextprocessingwhenfourconsecutivecharactersofaparticularselecttextencodingarefound.Thissettinghelpsfindandextracthelpfuldatafromthebinaryprocessing,reducingthenumberoffalsepositives.

7. ClickOK.Changestoharvestersettingsdonottakeeffectuntiltheapplianceisrebootedortheapplicationservicesarerestarted.

OpticalcharacterrecognitionprocessingOpticalcharacterrecognition(OCR)processingenablestextextractionfromgraphicimagefilesthatarestoredinsidearchiveswheretheIncludecontenttaggingandfull-textindexoptionisselected.

Parenttopic:ConfigurationofIBMStoredIQPlatform

RelatedconceptsConfigurationofIBMStoredIQPlatformOpticalcharacterrecognitionprocessing

IBMUnstructuredData751, p. 158

Page 168: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

OpticalcharacterrecognitionprocessingOpticalcharacterrecognition(OCR)processingenablestextextractionfromgraphicimagefilesthatarestoredinsidearchiveswheretheIncludecontenttaggingandfull-textindexoptionisselected.

AftercontenttypinginsidetheIBM®StoredIQPlatformprocessingpipeline,enablingOCRprocessingroutesthefollowingfiletypesthroughanopticalcharacterrecognitionengineOCRtoextractrecognizabletext.

WindowsorOS/2bitmap(BMP)Tagimagebitmapfile(TIFF)(TIFF)Bitmap(CompuServe)(GIF)PortableNetworkGraphics(PNG)

ThetextthatisextractedfromimagefilesisprocessedthroughtheIBMStoredIQPlatformpipelineinthesamemannerastextextractedfromothersupportedfiletypes.PolicieswithaspecificfeaturetowriteoutextractedtexttoaseparatefileforsupportedfiletypesdosoforimagefileswhileOCRprocessingisenabled.

TheOCRprocessingrateofimagefilesisapproximately7-10KB/secperIBMStoredIQPlatformharvesterprocess.

Parenttopic:Configuringharvestersettings

RelatedtasksConfiguringharvestersettings

IBMUnstructuredData751, p. 159

Page 169: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Configuringfull-textindexsettingsUsethefull-textindexsettingsfeaturetocustomizeyourfull-textindex.

AboutthistaskBeforeyouconfigureorsearchthefull-textindex,considerthefollowingsituations:

Full-textfiltersthatcontainwordsmightnotreturnallinstancesofthosewords:Youcanlimitfull-textindexingforwordsthatarebasedontheirlength.Forexample,ifyouchoosetofull-textindexwordslimitedto50characters,thennowordsgreaterthan50charactersareindexed.Full-textfiltersthatcontainnumbersmightnotreturnallinstancesofthosenumbers:Thissituationcanoccurwhennumbersearchesareconfiguredasfollows:

Thelengthofnumberstofull-textindexwasdefined.Ifyouconfigurethefull-textfiltertoindexnumberswith3digitsormoreandtrytoindexthenumbers9,99,999,andthewordstock,onlythenumber999andthewordstockareindexed.Thenumbers9and99arenotindexed.Numberindexingindataobjectsthatarelimitedbyfileextensions.Forexample,ifyouchoosetofull-textindexthenumber999whenitappearsindataobjectswiththefileextensions.XLSand.DOC,thenafull-textfilterreturnsonlythoseinstancesofthenumber999thatexistindataobjectswiththefileextensions.XLSand.DOC.Althoughthenumber999canexistinotherdataobjectsthatareharvested,thesedataobjectsdonothavethefileextensions.XLSor.DOC.

Procedure1. GotoAdministration>Configuration>Application>Full-textsettings.2. ToconfigureLimits:

a. Donotlimitthelengthofthewordsthatareindexed:Selectthisoptiontohavenolimitsonthelengthofwordsthatareindexed.

b. Limitthelengthofwordsindexedto___characters:Selectthisoptiontolimitthelengthofwordsthatareindexed.Enterthemaximumnumberofcharactersatwhichtoindexwords.Wordswithmorecharactersthanthespecifiedamountarenotindexed.

3. ToconfigureNumbers:Donotincludenumbersinthefull-textindex:Selectthisoptiontohavenoindexednumbers.Thisoptionisselectedbydefault.Includenumbersinthefull-textindex:Selectthisoptiontohavenumberstobeindexed.Includenumbersinfull-textindexbutlimitthemby:Selectthisoptiontohaveonlycertainnumbersindexed.Definetheselimitsasfollows:

Numberlength:Includeonlynumbersthatarelongerthan____characters.Enterthenumberofcharactersanumbermustcontaintobeindexed.TheNumberlengthfeatureindexeslongernumbersandignoresshorternumbers.Bynotindexingshorternumbers,suchasone-andtwo-characternumbers,youcanfocusyourfilteronmeaningfulnumbers.Thesenumberscanbeaccountnumbers,SocialSecuritynumbers,creditcardnumbers,licenseplatenumbers,ortelephonenumbers.Extensions:Indexnumbersthatarebasedonthefileextensionsofthedataobjectsinwhichtheyappear.SelectLimitnumbersforallextensionstolimitnumbersinallfileextensionstothecharacterlimitssetinNumberlength.Alternatively,selectLimitnumbersfortheseextensionstolimitthenumbersthatareselectedinNumberslengthonlytodataobjectswithcertainfileextensions.Enterthefileextensionsoneperlinethatmusthavelimitednumberindexing.Anydataobjectwithafileextensionthatisnotlistedhasallindexednumbers.

4. ConfigureStopwords.Stopwordsarecommonwordsthatarefoundindataobjects.

IBMUnstructuredData751, p. 160

Page 170: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Thesedataobjectsarenotindexedinthefull-textindex.Toindex,stopwordsliketheorbutwouldcompromisefull-textindexingspeedandtherelevancyoftheresults.Bydefault,thefollowingwordsareomittedfromthefull-textindex:a,an,and,are,as,at,be,but,by,for,if,in,into,is,it,no,not,of,on,or,such,that,the,their,then,there,these,they,this,to,was,will,with.

Ifyouwantthesystemtofindawordthatislisted,deletethewordfromthelisttoallowthefull-textindextofindit.Youmustreindextofindtheword.Toaddastopword,enteronewordperline,withoutpunctuation,whichincludeshyphensandapostrophes.

5. ConfigurePunctuationorspecialcharacterstoindexbyenteringpunctuationcharactersintheindex.Punctuationcharactersmustbeenteredwithoutspacestoseparatethem.Bydefault,onlysomepunctuationisindexedasaletterinawordbydefault.Mostpunctuationisturnedintoaspace.Tomakecertainthataspecificpunctuationcharacterisindexed,addittothislist.

6. ToconfigureIncludewordstemsinindex,selectwhethertostemwordsthatwereindexed.Forexample,employisthestemwordofwordssuchasemployed,employment,employs.Ifyouusestemmingandsearchforthetermemployed,IBM®StoredIQPlatformdenotesanyfoundinstancesofemployment,employ,employee,andsoon,whenitviewsthedataobject.

Donotstemwordsthatareindexed(fasterindexing):Bynotstemmingindexedwords,datasourcesareindexedfaster.Stemwordsthatareindexed(improvedsearching):Bystemmingindexedwords,filtersaremoreprecise,althoughslower.Withoutstemming,afilterfortradewouldneedtobewrittenastradeortradesortradingortradedtogetthesameeffect,andeventhenausercanmissaninterestingvariant.

Note:Ifstemmingfeatureisenabled,theuseofdoublequotationmarksreturnsstemmedtermsinresults.Tofindexactwordswithnostemmedterms,usesinglequotationmarks.

7. ToOptimizewildcardsuffixsearches,selectwhethertooptimizesearchesbysuffixsuchas*ology,*tion,*ious,*ive,or*less.

Donotoptimizesearchesbysuffix(fasterindexing):Bynotoptimizingsearchesbysuffix,datasourcesareindexedfaster.Optimizesearchesbysuffix(fastersearching):Byoptimizingsearchesbysuffix,searchesareconductedmorequickly;however,non-suffixsearchesorstandardwildcardsearches(suchasbird*)arenotaffected.

Note:Stemmingisnotconductedforsearchtermswithwildcards("?","*")inthem.Itistrueregardlessofthetermthatisplacedwithinsinglequotationmarks.

8. ClickOK.

Parenttopic:ConfigurationofIBMStoredIQPlatform

RelatedconceptsConfigurationofIBMStoredIQPlatform

IBMUnstructuredData751, p. 161

Page 171: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

SpecifyingdataobjecttypesOntheDataobjecttypespage,youcanaddnewdataobjecttypesandviewandeditknowndataobjecttypes.ThesedataobjectsappearintheDiskusage(bydataobjecttype)report.Currently,thereareover400dataobjecttypesavailable.

Procedure1. GotoAdministration>Configuration>Application>Dataobjecttypes.2. Intheadddataobjecttypesection,enteroneormoreextensionstoassociatewiththe

dataobjecttype.Theseentriesmustbeseparatesbyspaces.Forexample,enterdoctxtxls.

3. Enterthenameofthedataobjecttypetobeusedwiththeextensionorextensions.Forexample,enterMicrosoftWord.

4. ClickAddtoaddtheextensiontothelist.

Parenttopic:ConfigurationofIBMStoredIQPlatform

RelatedconceptsConfigurationofIBMStoredIQPlatform

IBMUnstructuredData751, p. 162

Page 172: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ConfiguringauditsettingsAuditsettingscanbeconfiguredtodeterminethenumberofdaysandnumberofpolicyauditstobekeptbeforetheyaredeleted.

Procedure1. GotoAdministration>Configuration>Application>Auditsettings.2. Specifythenumberofdaystokeepthepolicyauditsbeforeautomaticallydeletingthem.3. Specifythemaximumnumberofpolicyauditstokeepbeforeautomaticallydeleting

them.4. Specifythefilelimitfordrill-downinpolicyaudits.5. ClickOKtosavechanges.

Parenttopic:ConfigurationofIBMStoredIQPlatform

RelatedconceptsConfigurationofIBMStoredIQPlatform

IBMUnstructuredData751, p. 163

Page 173: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ConfiguringhashsettingsUsetheHashSettingspagetoconfigurewhethertocomputeahashwhenharvesting.Thepageprovidesdifferenttypesofhashes.

Procedure1. GotoAdministration>Configuration>Application>Hashsettings.2. SelectComputedataobjecthash.

Note:Whenyouhashemails,clickChooseemailfieldsandselectemailattributestobeused.Theemailhashselectionsoperateindependentlyfromthedataobjecthashsettings;thatis,adataobjectcanhaveabinaryhashoranemailhash,butnotboth.

3. Whenyouhashdataobjects,exceptforemails,specifythefollowingoptions:Entiredataobjectcontent(requiredfordataobjecttyping)Partialdataobjectcontent

4. ClickOK.

Parenttopic:ConfigurationofIBMStoredIQPlatform

RelatedconceptsConfigurationofIBMStoredIQPlatform

IBMUnstructuredData751, p. 164

Page 174: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ConfiguringdesktopsettingsWhenyouconfiguredesktopsettings,youareenablingordisablingencryptionwithinIBM®StoredIQPlatform.IBMDesktopDataCollector(desktopclientorclient)enablesdesktopsasavolumetypeordatasource,allowingthemtobeusedjustasothertypesofaddeddatasources.TheclientisprovidedasastandardMSIfile,andisinstalledaccordingtothetypicalmethod(suchasMicrosoftSystemsManagementService(SMS))usedwithinyourorganization.TheclientcancollectPSTsandcompressedfilesandotherdataobjectsanditiscapableofremovingitselfwhenitsworkiscompleted.

Procedure1. GotoAdministration>Configuration>Application>Desktopsettings.2. IntheDesktopServicesarea,selecttheEncryptalltrafficto/fromdesktopscheckbox.3. SelecteitherEnabledorDisabledtoenableordisabledesktopservices.4. ClickApply.

Parenttopic:ConfigurationofIBMStoredIQPlatform

RelatedconceptsConfigurationofIBMStoredIQPlatform

IBMUnstructuredData751, p. 165

Page 175: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DownloadingtheIBMDesktopDataCollectorinstallerfromtheapplicationTheIBM®DesktopDataCollectorinstallercanbedownloadedfromtheapplication.

Procedure1. GotoAdministration>Configuration>Application>Desktopsettings.2. IntheDownloadtheDesktopAgentinstallerarea,clickDownloadthedesktopclient

installer.3. Whenthedownloadiscomplete,clickSaveFile.

ResultsAfterthedesktopclientisinstalledonadesktopandconnectedtoandregisteredwiththedataserver,thatdesktopisavailableasadatasourcewithinthelistofprimaryvolumes.ConnectivityandthecorrectIPaddressarerequired.

Parenttopic:ConfigurationofIBMStoredIQPlatform

RelatedconceptsConfigurationofIBMStoredIQPlatform

IBMUnstructuredData751, p. 166

Page 176: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

UpgradingtheIBMDesktopDataCollectoragentTheIBM®DesktopDataCollectoragentmustbeupgradedtoopenandharvestencryptedfiles.

AboutthistaskDuringIBMDesktopDataCollectorcollection,ifIBMDesktopDataCollectorfindsanEncryptedFileSystem-encryptedfile,thenIBMDesktopDataCollectorinstallsarecoveryagentcertificate,allowingtheclienttoopentheencryptedfileandharvestfromit.

Procedure1. GotoAdministration>Configuration>Application>Desktopsettings.2. IntheUpgradesarea,selecteitherAutomaticupgradeorAvailableversions.3. ForAutomaticupgradeoptions:

Upgradesdisabled:Allupgradesaredisabled,thatis,noneisapplied.Upgradeallworkstations:Allworkstationsareupgraded.

4. ForAvailableversionsoptions:SelectManuallypublishnewversion,andthenselectthatversion.SelectAutomaticallypublishthelatestversion.

5. ClickApply.

Parenttopic:ConfigurationofIBMStoredIQPlatform

RelatedconceptsConfigurationofIBMStoredIQPlatform

IBMUnstructuredData751, p. 167

Page 177: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ManagingtheEncryptedfilesystemrecoveryagentDuringIBM®DesktopDataCollectorcollection,ifIBMDesktopDataCollectorfindsanEncryptedFileSystem-encryptedfile,theIBMDesktopDataCollectorinstallsarecoveryagentcertificatesothatyoucanopentheencryptedfile.

Procedure1. GotoAdministration>Configuration>Application>Desktopsettings.2. IntheEncryptedfilesystemrecoveryagentusersarea,clickAddencryptedfilesystem

user.TheUploadRecoveryAgentCertificatedialogboxappears.3. IntheSelecta.PFXfiletoupload:textbox,clickBrowsetogotothewanted.PFXfile.

Bydefault,thesystemtakesa.PFXfile.4. Enterthe.PFXpasswordinthe.PFXpassword:textbox.Thispasswordprotectsthefile

itself.5. IntheUsername:textbox,entertheusernamefortheuser,aSAMcompatible/NT4

Domainname-styleusername.Forexample,enterMYCOMPANY\esideways.Thisusernameisthecredentialoftheusertowhomthisrecoveryagentbelongs.

6. InthePassword:textbox,enterthepasswordfortheuser.7. Optional:EnteradescriptionintheDescription:textbox.8. ClickOK.Thefileisuploaded,andtheaddeduserisvisiblewithintheUsername

column.Note:Afterusersareadded,theycanalsobeeditedordeletedwiththeEditorDeleteoptions.

Parenttopic:ConfigurationofIBMStoredIQPlatform

RelatedconceptsConfigurationofIBMStoredIQPlatform

IBMUnstructuredData751, p. 168

Page 178: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

VolumesanddatasourcesVolumesordatasourcesareintegraltoIBM®StoredIQPlatformindexingyourdata.

AvolumerepresentsadatasourceordestinationthatisavailableonthenetworktotheIBMStoredIQPlatformappliance.Avolumecanbeadiskpartitionorgroupofpartitionsthatisavailabletonetworkusersasasingledesignateddriveormountpoint.IBMStoredIQPlatformvolumeshavethesamefunctionaspartitionsonaharddiskdrive.WhenyouformattheharddiskdriveonyourPCintodrivepartitionsA,B,andC,youarecreatingthreepartitionsthatfunctionlikethreeseparatephysicaldrives.Volumesbehavethesamewaythatharddiskdrivediskpartitionsbehave.Youcansetupthreeseparatevolumesthatoriginatefromthesameserveroracrossmanyservers.Onlyadministratorscandefine,configure,andaddorremovevolumestoIBMStoredIQPlatform.

VolumeindexingWhenyoudefinevolumes,youcandeterminethetypeanddepthofindexthatisconducted.ServerplatformconfigurationBeforeyouconfigurevolumesonIBMStoredIQPlatform,youmustconfiguretheserverplatformsthatyouuseforthedifferentvolumetypes.Eachservertypehasrequisitepermissionsandsettings.ConfigurationofretentionserversIBMStoredIQPlatformsupportsvarioustypesofretentionservers,whichmustbeconfiguredbeforeretentionvolumesareaddedduetouniquerequirements.CreatingprimaryvolumesPrimaryvolumescanbecreatedasdatasources.CreatingretentionvolumesRetentionvolumesstoredataobjectsthatareplacedunderretention.Itmeansthattheobjectisretained.CreatingdiscoveryexportvolumesDiscoveryexportvolumescontainthedataproducedfromapolicy,whichiskeptsothatitcanbeexportedasaloadfileanduploadedintoalegalreviewtool.Administratorscanalsoconfigurediscoveryexportvolumesformanagingharvestresultsfromcyclesofadiscoveryexportpolicy.CreatingsystemvolumesSystemvolumessupportvolumeexportandimport.Whenyouexportavolume,dataisstoredonthesystemvolume.Whenyouimportavolume,dataisimportedfromthesystemvolume.ExportandimportofvolumedataThesystem’sexportandimportvolumecapabilitiesallowmetadataandfull-textindexeddatatobecollectedorexportedfromseparatelocations,suchasdataserverslocatedinvariousofficesoftheenterprise.Oncethedataisavailable,itcanbeimportedtoasinglelocation,suchasaheadquarter'sofficedataserver,whereselectedfilesmightberetained.DeletingvolumesAdministratorscandeletevolumesfromthelistofavailabledatasources,providedthatthedataserverisconnectedtothegateway.PolicylimitationsforvolumetypesVolumetypeshavedifferentpolicylimitations.

RelatedtasksCreatingretentionvolumes

IBMUnstructuredData751, p. 169

Page 179: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

VolumeindexingWhenyoudefinevolumes,youcandeterminethetypeanddepthofindexthatisconducted.

Therearethreelevelsofanalysis:

Systemmetadataindex:Thislevelofanalysisrunswitheachdatacollectioncycleandprovidesonlysystemmetadataforsystemdataobjectsinitsresults.Itisusefulasasimpleinventoryofwhatdataobjectsarepresentinthevolumesyoudefinedandformonitoringresourceconstraints(suchasfilesize)orprohibitedfiletypes(suchas.MP3s).Systemmetadatapluscontainers:Inasimplesystemmetadataindex,containerdataobjects(compressedfiles,PSTs,emailswithattachments,andthelike)arenotincluded.Thislevelofanalysisprovidescontainer-levelmetadatainadditiontothesystemmetadataforsystemdataobjects.Full-textandcontenttagging:Thisoptionprovidesthefulllocallanguageanalysisthatyieldsthemoresophisticatedentitytags.Naturally,completingafull-textindexrequiresmoresystemresourcesthanametadataindex.UsersmustcarefullydesigntheirvolumestructureandharvestssothatthemaximumbenefitofIBM®StoredIQPlatform'ssophisticatedanalyticsareused,butnotonresourcesthatdonotrequirethem.Parametersandlimitationson“full-text”indexingaresetwhenthesystemisconfigured.

Parenttopic:Volumesanddatasources

RelatedconceptsVolumesanddatasourcesConfigurationofretentionserversServerplatformconfiguration

IBMUnstructuredData751, p. 170

Page 180: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ServerplatformconfigurationBeforeyouconfigurevolumesonIBM®StoredIQPlatform,youmustconfiguretheserverplatformsthatyouuseforthedifferentvolumetypes.Eachservertypehasrequisitepermissionsandsettings.

BecauseIBMStoredIQPlatformsupportsseveraldifferenttypesofvolumes,serverplatformsmustbeconfiguredtosupportthosevolumetypes.

ConfiguringWindowsShare(CIFS)WindowsShare(CIFS)mustbeconfiguredtoharvestandrunpolicies.ConfiguringNFSNFSmustbeconfiguredtoharvestandrunpolicies.ConfigurationofExchangeserversWhenyouconfigureExchangeservers,youmustconsidervariousconnectionsandpermissions.ConfigurationofSharePointWhenyouconfigureSharePoint,certainprivilegesarerequiredbyuseraccountalongwithIBMStoredIQPlatformrecommendations.Additionally,SharePoint2007and2010requiretheconfigurationofalternate-accessmappingstomapIBMStoredIQPlatformrequeststothecorrectwebsites.ConfiguringDocumentumDocumentumhasconfigurationrequirementswhenitisusedasaserverplatform.ConfiguringEnterpriseVaultsitesEnterpriseVaultsitesmustbeconfiguredbeforetheadditionofanEnterpriseVaultvolume.ConfigurationofDiscoveryAcceleratorBeforeyouconfigureDiscoveryAcceleratorprimaryvolumes,youmustconfigureDiscoveryAcceleratorcustomerinformationandEnterpriseVaultsitessequentiallysothatcertainconfigurationitemscanappearinthevolumeconfigurationlists.ConfiguringNewsGatorWhenNewsGatorisusedasaserverplatform,severalprivilegesmustbeconfigured.

Parenttopic:Volumesanddatasources

RelatedconceptsVolumesanddatasourcesConfigurationofretentionserversVolumeindexingConfigurationofExchangeserversConfigurationofSharePointConfigurationofDiscoveryAccelerator

RelatedtasksConfiguringWindowsShare(CIFS)ConfiguringNFSConfiguringDocumentumConfiguringEnterpriseVaultsitesConfiguringNewsGator

IBMUnstructuredData751, p. 171

Page 181: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ConfiguringWindowsShare(CIFS)WindowsShare(CIFS)mustbeconfiguredtoharvestandrunpolicies.

ProcedureToharvestandrunpoliciesonvolumesonWindowsShare(CIFS)servers,theusermustbeinthebackupoperatorgroupontheWindowsShareserverthatshowsthesharesonIBM®StoredIQPlatform.

Parenttopic:Serverplatformconfiguration

RelatedconceptsServerplatformconfigurationConfigurationofExchangeserversConfigurationofSharePoint

IBMUnstructuredData751, p. 172

Page 182: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ConfiguringNFSNFSmustbeconfiguredtoharvestandrunpolicies.

ProcedureToharvestandrunpoliciesonNFSservers,youmustenablerootaccessontheNFSserverthatisconnectedtoIBM®StoredIQPlatform.

Parenttopic:Serverplatformconfiguration

RelatedconceptsServerplatformconfigurationConfigurationofExchangeserversConfigurationofSharePoint

IBMUnstructuredData751, p. 173

Page 183: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ConfigurationofExchangeserversWhenyouconfigureExchangeservers,youmustconsidervariousconnectionsandpermissions.

Secureconnection:IfyouwanttoconnecttoExchangevolumesoverHTTPS,youmustaddportnumber443aftertheservername,forexample,qa03exch2000.qaw2k.local:443.Insomecases,thissecureconnectioncanresultinsomeperformancedegradationduetoSSLrunninglarge.Ifyouenterthevolumeinformationwithoutthe443suffix,thedefaultconnectionwillbeoverHTTP.PermissionsforExchange2003:ThefollowingpermissionsmustbesetontheExchangeservertothemailboxstoreorthemailboxesfromwhichyouharvest.

ReadExecuteReadpermissionsListcontentsReadpropertiesListobjectReceiveas

PermissionsforExchange2007and2010:TheFullAccesspermissionsmustbesetontheExchangeservertothemailboxstoreorthemailboxesfromwhichyouwillharvest.RecoverableitemsinExchange2010:ToharvesttherecoverableitemsfoldersinExchange2010,youmustbeloggedinasanadministratorrole.Deleteditems:ToharvestitemsthatweredeletedfromtheExchangeserver,enableExchange’stransportdumpstersettings.Formoreinformation,seeMicrosoft®ExchangeServer2010Administrator'sPocketConsultant.Configurationinformationisalsoavailableonlineatwww.microsoft.com.WindowsAuthentication:Forallsupportedversions,enableIntegratedWindowsAuthenticationoneachExchangeserver.

EnablingintegratedWindowsauthenticationonExchangeserversWindowsauthenticationcanbeintegratedonExchangeservers.ImprovingperformanceforIIS6.0andExchange2003WithinIBMStoredIQPlatform,performancecanbeimprovedforIIS6.0andExchange2003.

Parenttopic:Serverplatformconfiguration

RelatedconceptsServerplatformconfiguration

RelatedtasksConfiguringWindowsShare(CIFS)ConfiguringNFSEnablingintegratedWindowsauthenticationonExchangeserversImprovingperformanceforIIS6.0andExchange2003

IBMUnstructuredData751, p. 174

Page 184: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

EnablingintegratedWindowsauthenticationonExchangeserversWindowsauthenticationcanbeintegratedonExchangeservers.

Procedure1. FromMicrosoftWindows,logintotheExchangeServer.2. GotoAdministrativeTools>InternetInformationServices(IIS)Manager.3. GotoInternetInformationServices>NameofExchangeServer>WebSites>Default

WebSite.4. Right-clickDefaultWebSite,andthenclicktheDirectorySecuritytab.5. IntheAuthenticationandaccesscontrolpane,clickEdit.6. SelectProperties.TheAuthenticationMethodswindowappears.7. IntheAuthenticationaccesspane,selecttheIntegratedWindowsauthenticationcheck

box.8. ClickOK.9. RestartIISservices.

Parenttopic:ConfigurationofExchangeservers

RelatedconceptsConfigurationofExchangeservers

IBMUnstructuredData751, p. 175

Page 185: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ImprovingperformanceforIIS6.0andExchange2003WithinIBM®StoredIQPlatform,performancecanbeimprovedforIIS6.0andExchange2003.

Procedure1. FromMicrosoftWindows,logontotheExchangeServer.2. GotoAdministrativeTools>InternetInformationServices(IIS)Manager.3. SelectInternetInformationServices><NameofExchangeServer>>WebSites>

ApplicationPools.4. Right-clickApplicationPoolsandselectProperties.5. OnthePerformancetab,locatetheWebGardensection.6. Ifthenumberofworkerprocessesisdifferentfromthedefaultvalueof1,thenchange

thenumberofworkerprocessesto1.7. ClickOK.8. RestartIISServices.

Parenttopic:ConfigurationofExchangeservers

RelatedconceptsConfigurationofExchangeservers

IBMUnstructuredData751, p. 176

Page 186: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ConfigurationofSharePointWhenyouconfigureSharePoint,certainprivilegesarerequiredbyuseraccountalongwithIBM®StoredIQPlatformrecommendations.Additionally,SharePoint2007and2010requiretheconfigurationofalternate-accessmappingstomapIBMStoredIQPlatformrequeststothecorrectwebsites.

ToconfigureSharePoint,considertheseconnectionsandprivileges:

SecureConnectionIfyouwanttoconnecttoSharePointvolumesoverHTTPS,youcanusetheUseSSLcheckbox,orcanaddtheportnumber443aftertheservernamewhenyousetupthevolumeonIBMStoredIQPlatform,forexample,qa01.company.com:443.Insomecases,thissecureconnectioncanresultinsomeperformancedegradationduetoSecureSocketLayer(SSL)runninglarge.Ifyouenterthevolumeinformationwithoutthe443suffix,thedefaultconnectionisoverHTTP.

PrivilegesTorunpoliciesonSharePointservers,youmustusecredentialswithFullControlprivileges.Useasitecollectionadministratortoharvestsubsitesofasitecollection.

PrivilegesrequiredbyuseraccountIBMStoredIQPlatformistypicallyusedwithSharePointforoneoftheseinstances:toharvestandtreatSharePointasasourceforpolicyactionsortouseasadestinationforpolicyactions,whichmeansthatyoucanwritecontentintoSharePointwith.Considerthesepoints:

AttributesarenotsetorresetonaSharePointharvestorifyoucopyfromSharePoint.AttributesaresetonlyifyoucopytoSharePoint.

Youmustdenotethefollowingsituations:

IfyouplantoreadonlyfromtheSharePoint(harvestandsourcecopiesfrom),thenyoumustuseusercredentialswithReadprivilegesonthesiteandallofthelistsanddataobjectsthatyouexpecttoprocess.IfyouplantouseSharePointasadestinationforpolicies,youmustuseusercredentialswithContributeprivilegesonthesite.MorePrivilegesforSocialData:IfyouwanttoindexallthesocialdataforauserprofileinSharePoint2010,thentheusercredentialsmustownprivilegestoManageSocialDataaswell.RecommendedPrivileges:Useasitecollectionadministratortoensurethatalldataisharvestedfromasiteorsitecollection.

Alternate-accessmappingsAlternate-accessmappingsmapURLspresentedbyIBMStoredIQPlatformtointernalURLsreceivedbyWindowsSharePointServices.Analternate-accessmappingisrequiredbetweentheservernameandoptionalportthatisdefinedintheSharePointvolumedefinitionandtheinternalURLofthewebapplication.IfSSLisusedtoaccessthesite,ensurethatthealternate-accessmappingURLuseshttps://astheprotocol.

RefertoMicrosoftSharePoint2007or2010documentationtoconfigurealternate-accessmappings.ThesemappingsarebasedonthepublicURLthatisconfiguredbythelocalSharePointadministratorandusedbytheIBMStoredIQPlatformSharePointvolumedefinitions.

Forexample,youareaccessingaSharePointvolumewiththefullyqualifieddomainname,http://itweb.storediqexample.com,fromtheintranetzone.Analternate-accessmappingforthepublicURLhttp://itweb.storediqexample.comfortheintranetzonemustbeconfiguredfortheSharePoint2007or2010webapplicationthathoststhesitetobeaccessedbythevolume

IBMUnstructuredData751, p. 177

Page 187: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

definition.IfyouareaccessingthesamevolumewithSSL,themappingaddedmustbefortheURLhttps://itweb.storediqexample.cominstead.

Note:WhenyouconfigureSharePointvolumeswithnon-qualifiednames,youareenteringtheURLforaSharePointsitecollectionorsitethatisusedbyIBMStoredIQPlatforminthevolumedefinition.Considerthefollowingconditions:

TheURLmustbevalidabouttheAlternateAccessMappingsthatareconfiguredinSharePoint.IfthehostnameintheURLdoesnotconveythefullyqualifieddomaintoauthenticatetheconfigureduser,anActiveDirectoryservermustbespecified.ThespecifiedActiveDirectorymustbeafullyqualifieddomainnameandisusedforauthentication.

Parenttopic:Serverplatformconfiguration

RelatedconceptsServerplatformconfiguration

RelatedtasksConfiguringWindowsShare(CIFS)ConfiguringNFS

IBMUnstructuredData751, p. 178

Page 188: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ConfiguringDocumentumDocumentumhasconfigurationrequirementswhenitisusedasaserverplatform.

ProcedureTorunharvestsandcopyfromDocumentumservers,youmustusetheContributorrole.

Parenttopic:Serverplatformconfiguration

RelatedconceptsServerplatformconfiguration

IBMUnstructuredData751, p. 179

Page 189: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ConfiguringEnterpriseVaultsitesEnterpriseVaultsitesmustbeconfiguredbeforetheadditionofanEnterpriseVaultvolume.

Procedure1. GotoAdministration>Datasources>Specifyservers.2. ClickEnterpriseVaultsites,andthenclickAddnewEnterpriseVaultsite.3. IntheSitenamefield,enterauniquelogicalsitename.Thisnameappearsinthescreens

thatareusedtoconfigureEnterpriseVaultvolumes.4. IntheEnterpriseVaultsitealiasfield,entertheFQDNoftheEnterpriseVaultServer.

Eachservercanbeaddedonlyonetime.5. IntheUsernamefield,entertheloginname.Iftheuserisadomainuser,thenenterthe

loginnameasdomain\user.TheEnterpriseVaultServiceAccountorauserwithequivalentprivilegesmustbeused.

6. InthePasswordfield,entertheuser’spasswordtoauthenticatewithActiveDirectory.7. ClickOKtosavethesite.

Parenttopic:Serverplatformconfiguration

RelatedconceptsServerplatformconfiguration

IBMUnstructuredData751, p. 180

Page 190: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ConfigurationofDiscoveryAcceleratorBeforeyouconfigureDiscoveryAcceleratorprimaryvolumes,youmustconfigureDiscoveryAcceleratorcustomerinformationandEnterpriseVaultsitessequentiallysothatcertainconfigurationitemscanappearinthevolumeconfigurationlists.

YoumustlogintotheDiscoveryAcceleratorserverandruntheImportExport.exetoolintheinstallationfoldertoobtaintheappropriateCustomerIDsandcustomerdatabasenames.

DiscoveryAcceleratorWeb-ServicesInterface:InorderforIBM®StoredIQPlatformtointerfacewithEnterpriseVaultwiththeDiscoveryAcceleratorwebservices,thefollowingconfigurationsmustbemadeontheDiscoveryAcceleratorservice.

1. LogintotheDiscoveryAcceleratorclientinterfaceasaVaultUserorDiscoveryAdministrator.

2. ClicktheConfigurationtabandexpandtheAPIoptionsontheSettingspage.3. IntheAPIsettingsgroup,ensurethattheAPIEnabledsettingisenabled.4. ConfigureaTemporaryStorageAreaasneeded.Ensurethatithassufficientfree

spaceandthatanyauthenticatedusersthatdefinevolumesagainstDiscoveryAcceleratorhaveFullControlpermissionsonthisstoragearea.Additionally,considerconfiguringtheTemporaryStorageAreaCleanupInterval.Dependingonthesizeoftheclusterthatisdeployed,typically,thedefaultvalueof30minutescanbesufficient.Ifgreaterthanfournodesinthecluster,thisintervalmustbereducedformorefrequentcleanupstofreeupstoragespace.

ImproveperformanceforIIS6.0:IftheDiscoveryAcceleratorserverrunsoverIIS6.0,anexistingbuginIIScausessevereperformancedegradationwhenusedalongwithKerberosauthentication.ThehotfixdescribedinMicrosoftKnowledgeBasearticle917557(http://support.microsoft.com/kb/917557)canbeappliedtotheserverinthiscase.

DiscoveryAcceleratorpermissionsThecredentialsthatareusedforreferencingtheEnterpriseVaultSitearecredentialsoftheVaultUseroranyotheradministrator.IBMStoredIQPlatformvalidatesthatthecredentialsarestrongenoughforitto:

LoginremotelytothespecifiedserverPerformDCOMoperationsoverRPCremotely

ToharvestaDiscoveryAcceleratorvolumesuccessfully,ausermusthavethefollowingprivileges:

ArolethatisdefinedintheDiscoveryAcceleratorWebApplicationReviewmessagespermissionforthecasethatisusedinthevolumedefinitionFolderreviewpermissionsonacase,ifafolder(sometimesalsocalledaResearchFolder)inthecaseisgoingtobeharvestedPermissiontosetallofthereviewmarksthatareselectedforthevolumedefinition

ConfiguringsecuritysettingsforEnterpriseVaultserversThefollowingprocedureaddressesonlythestandardsecuritysettingsthatmustbeconfiguredontheWindowsServershostingEnterpriseVaulttoallowittointeractwithIBMStoredIQPlatform.

Parenttopic:Serverplatformconfiguration

RelatedconceptsServerplatformconfiguration

Relatedtasks

IBMUnstructuredData751, p. 181

Page 191: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ConfiguringsecuritysettingsforEnterpriseVaultservers

IBMUnstructuredData751, p. 182

Page 192: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ConfiguringsecuritysettingsforEnterpriseVaultserversThefollowingprocedureaddressesonlythestandardsecuritysettingsthatmustbeconfiguredontheWindowsServershostingEnterpriseVaulttoallowittointeractwithIBM®StoredIQPlatform.

Procedure1. GotoAdministration>Datasources>Specifyservers.2. ClickDiscoveryAcceleratorcustomers,andthenclickAddnewDiscoveryAcceleratorcustomer.

3. IntheCustomernamefield,enterauniquedisplaynameoftheDAcustomer.ThisnameappearsinthescreensthatareusedtoconfigureEnterpriseVaultvolumes.

4. IntheDiscoveryAcceleratorserverfield,entertheDNSnameofthephysicalserverthatrunsDiscoveryAccelerator.

5. IntheDiscoveryAcceleratorcustomerIDfield,enterthecustomerIDvaluethatisobtainedfromDiscoveryAccelerator.EachuniquecombinationofDiscoveryAcceleratorservernameandcustomerIDcanbeusedonlyonetime.

6. IntheCustomervirtualdirectoryfield,entertheIISVirtualDirectorywheretheDiscoveryAcceleratorwebserviceislocated.

7. IntheDiscoveryAcceleratorinstallationfolderfield,enterthepathwhereEnterpriseVaultBusinessAcceleratorwasinstalledontheDiscoveryAcceleratorserver.IBMStoredIQPlatformrequiresthispathsothatDiscoveryAcceleratorcanbeaccessedduringconfiguration.

8. ClickOKtosavethesite.

Parenttopic:ConfigurationofDiscoveryAccelerator

RelatedconceptsConfigurationofDiscoveryAccelerator

IBMUnstructuredData751, p. 183

Page 193: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ConfiguringNewsGatorWhenNewsGatorisusedasaserverplatform,severalprivilegesmustbeconfigured.

AboutthistaskPrivilegesRequiredbyUserAccount:TheuseraccounttoharvestorcopyfromaNewsGatorvolumemusthavetheLegalAuditpermissionontheNewsGatorSocialPlatformServicesrunningontheSharePointfarm.

Procedure1. LoginasanadministratortoyourSharePointCentralAdministrationSite.2. UnderApplicationManagement,selectManageServiceApplications.3. IntheManageServiceApplicationsscreen,selecttheNewsGatorSocialPlatform

Servicesrow.4. Fromthetoolbar,selectAdministrators.5. AddtheuseraccountthatisusedfortheNewsGatorharvesttothelistofadministrators.

EnsurethattheaccounthastheLegalAuditpermission.

Parenttopic:Serverplatformconfiguration

RelatedconceptsServerplatformconfiguration

IBMUnstructuredData751, p. 184

Page 194: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ConfigurationofretentionserversIBM®StoredIQPlatformsupportsvarioustypesofretentionservers,whichmustbeconfiguredbeforeretentionvolumesareaddedduetouniquerequirements.

RetentionserversmustbeconfiguredbeforeyouaddretentionvolumestoIBMStoredIQPlatform.AsIBMStoredIQPlatformsupportsdifferenttypesofretentionservers,therearevariousconfigurationoptions.

CreatingCenterapoolsWhenaCenterapooliscreated,anemptyvolumesetisautomaticallycreatedandassociatedwiththeCenterapool.ThisfeatureenablestheharvestingofunknownCenteravolumessobusinesspoliciescanbeappliedtodataobjectsonalreadyretainedstorageservers.Thevolumesetcannotbeeditedordeletedfromthemanagevolumesetspage.ConfiguringtheDellDXObjectStoragePlatformADellDXStorageClustermustbedefinedbeforeaDellDXStoragevolumecanbeadded.Afteryoudefinethecluster,theclusterisavailableinthelistofavailableoptionswhenaDellDXStoragevolumeisadded.ConfiguringEnterpriseVaultWhenyouconfigureEnterpriseVaultasaretentionvolume,youmustconfigurebothsecuritysettingsandDCOM.ConfiguringIBMInformationArchiveRetentionServersBeforeyoucreateretentionvolumes,youneedtoconfiguresettingsonyourIBMInformationArchiveretentionserver.Filesthataresenttoretentionmusthaveacorrespondingmanagementclasstomanagetheretentionperiodsettings.Theseclassesrequireadefinedclass,policydomain,policyset,andnodeontheIBMInformationArchiveretentionserver.NetAppSnapLockWhenyouconfigureNetAppSnapLockasaretentionserver,certainconfigurationrequirementsmustbemet.HitachiHCAPconfigurationrequirementsInorderforIBMStoredIQPlatformtoaccesstheHitachiHCAPserver,certainconfigurationrequirementsmustbemet.

Parenttopic:Volumesanddatasources

RelatedconceptsServerplatformconfigurationVolumeindexingConfiguringEnterpriseVaultNetAppSnapLockHitachiHCAPconfigurationrequirements

RelatedtasksCreatingCenterapoolsConfiguringtheDellDXObjectStoragePlatformConfiguringIBMInformationArchiveRetentionServersConfiguringFileNetConfiguringChattermessages

IBMUnstructuredData751, p. 185

Page 195: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

CreatingCenterapoolsWhenaCenterapooliscreated,anemptyvolumesetisautomaticallycreatedandassociatedwiththeCenterapool.ThisfeatureenablestheharvestingofunknownCenteravolumessobusinesspoliciescanbeappliedtodataobjectsonalreadyretainedstorageservers.Thevolumesetcannotbeeditedordeletedfromthemanagevolumesetspage.

AboutthistaskAdvancedretentionfeaturemustbeenabled.

Permissions:TosupportallIBM®StoredIQPlatformfeatures,thefollowingeffectiveaccessprofilerightstoaCenterapoolmustbeenabled:

Read(D)elete(Q)uery(E)xist(W)riteRetention(H)old

CenteraPools:IfyouhaveanintegratedCenteraserver,youneedtocreateaCenterapoolbeforeyoucanaddaCenteravolume.Unlikeothervolumes,CenteraserversarenotplacedintovolumesetsbutintoCenteraPools.Afteryoucreateapool,theCenterapoolisinthelistofavailablechoiceswhenaCenteravolumeisadded.

Procedure1. GotoAdministration>Datasources>Specifyvolumes.2. InCenterapools,clickCreatenewpooltoopentheCenterapooleditor.3. EnterauniquenamefortheCenterapoolintheIBMStoredIQPlatformpoolprofile

nametextbox.4. Choosehowtodefinethepool.SelecteitherStructuredOutputorSingletextfieldand

enteraconnectionstring.SpecifyAccess:EnteraprofilenameandSecretforthepool.Use.peafile:Thisfileisapool-entryauthorization.Forinformationaboutcreatingthistypeoffile,seeCenteraMonitorandAdministrationGuide.

5. IfyouchoseStructuredinput,clickAddnewconnectionintheConnectionssection.6. EntertheIPaddressforanaccesspointontheserver,andthenclickAdd.Multiple

accesspointscanbespecifiedforfailoverintheeventofaproblematicaccessnode.7. ClickOKtosavethepool.ThepoolisnowavailableintheAddvolumesdialogwhena

Centeravolumeisadded.

Parenttopic:Configurationofretentionservers

RelatedconceptsConfigurationofretentionserversNetAppSnapLockHitachiHCAPconfigurationrequirements

IBMUnstructuredData751, p. 186

Page 196: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ConfiguringtheDellDXObjectStoragePlatformADellDXStorageClustermustbedefinedbeforeaDellDXStoragevolumecanbeadded.Afteryoudefinethecluster,theclusterisavailableinthelistofavailableoptionswhenaDellDXStoragevolumeisadded.

Procedure1. GotoAdministration>Datasources>SpecifyServers>DellDXStorageClusters.2. IntheDellDXStorageClusterlist,selectAddnewDellDXStorageCluster.3. EnterauniquenamefortheProfilename.4. EntertheDellDXStorageClustername.ThisnamemustbethesamewhentheDXCSNisconfigured.

5. Enteraportnumberthatisusedtocommunicatewiththestoragecluster.Thedefaultvalueis80.

6. Optional:Specifyalternativeaddressestobeusedtocommunicatewiththestoragecluster.ThisaddressmustbeoneormoreIPaddressesorDNSnamesthatmaptoDXStorageNodesorDXCSNinthecluster.Individualentriesmustbeseparatedbyacomma.

7. Optional:SpecifytheIPaddressorDNSnameforaDRSiteDXCSNthatcanbeusedforfailover.

8. EnteraStartingIPaddressforcluster.EachnodeintheIBM®StoredIQPlatformclusterisassignedanIPaddressintheDellDXStorageClusterprivatenetwork.TheStartingIPaddressmustbeanunused,validIPaddresswithintheDellDXStorageClusterprivatenetwork.Forexample,if172.17.17.100isenteredforafive-nodeIBMStoredIQPlatformcluster,172.17.17.100,172.17.17.101,172.17.17.102,172.17.17.103,and172.17.17.104areusedbyIBMStoredIQPlatform.

9. EntertheNetmaskvaluefortheDellDXStorageClusterprivatenetwork.Typically,thisvalueis255.255.255.0.

10. ThevalueoftheSwitchport,whichmustbeusedontheIBMStoredIQPlatformswitchestolinkwiththeDellDXStorageCluster.

Parenttopic:Configurationofretentionservers

RelatedconceptsConfigurationofretentionserversNetAppSnapLockHitachiHCAPconfigurationrequirements

IBMUnstructuredData751, p. 187

Page 197: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ConfiguringEnterpriseVault

WhenyouconfigureEnterpriseVaultasaretentionvolume,youmustconfigurebothsecuritysettingsandDCOM.

BeforeyouuseEnterpriseVaulttocreateretentionvolumes,youmustconfigureDiscoveryAcceleratorcustomersandEnterpriseVaultsitessequentiallysothatcertainconfigurationitemscanappearintheretentionvolumeconfigurationlists.YoumustlogintoDiscoveryAcceleratorandruntheImportExport.exetooltoobtaintheappropriateCustomerIDsandcustomerdatabasenames.

Note:IfyouuseasystemotherthanIBM®StoredIQPlatformtoimportdataintoEnterpriseVaultbutstillwanttouseIBMStoredIQPlatformforexportingoutofDiscoveryAccelerator,youmustdefineanEnterpriseVaultsitewithinIBMStoredIQPlatformandthenusethatsitetodefineaDiscoveryAcceleratorvolume.WhenyoudefinetheEnterpriseVaultsite,configuringDCOMconfigurationisaprerequisite.

Parenttopic:Configurationofretentionservers

RelatedconceptsConfigurationofretentionserversNetAppSnapLockHitachiHCAPconfigurationrequirements

EnablingremoteDCOM

RemoteDCOMisrequiredonallEnterpriseVaultserversandDiscoveryAccelerator.

AboutthistaskYoucanusetheDCOMConfigutility(DCOMCnfg.exe)foundinAdministrativeToolsinControlPaneltoconfigureDCOMsettingsasComponentServices.ThisutilitydisplaysthesettingsthatenablecertainuserstoconnecttothecomputerremotelythroughDCOM.MembersoftheAdministratorsgroupareallowedtoconnectremotelytothecomputerbydefault.

IftheEnterpriseVaultServiceAccountortheuserwhosecredentialsareusedtodefinetheEnterpriseVaultSiteIBMStoredIQPlatformdoesnothavepermissionstoconnectremotelyforDCOM,thenfollowthisprocedureonthetargetserver.

Procedure1. Rundcomcnfgasauserwithadministratorprivileges.2. IntheComponentServicesdialogbox,expandComponentServices,expandComputers,

andthenright-clickMyComputer>DefaultProperties.Ifnotalreadyenabled,selecttheEnableDistributedCOMonthisComputercheckbox.

3. ClicktheCOMSecuritytab.4. UnderLaunchandActivationPermissions,clickEditLimits.5. IntheLaunchPermissiondialogbox,followthesestepsiftheusernamedoesnotappear

intheGroupsorusernameslist:a. IntheLaunchPermissiondialogbox,clickAdd.b. IntheSelectUsers,Computers,orGroupsdialogbox,addtheusernameandthen

clickOK.c. IntheLaunchPermissiondialogbox,selectyouruserandintheAllowcolumn

underPermissionsforUser,selectRemoteLaunchandselectRemoteActivation,andthenclickOK.

AllowingDCOMtrafficthroughtheWindowsfirewall

IBMUnstructuredData751, p. 188

Page 198: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DCOMtrafficmustbeallowedthroughtheWindowsfirewallforEnterpriseVaultserversandDiscoveryAccelerator.

AboutthistaskToallowDCOMtrafficoverthenetworkonthetargetserver,theDCOMTCPport(135)mustbeopenontheFirewall.Thiscommandopensthisportifitisclosed:

netshfirewalladdportopeningprotocol=tcpport=135name=DCOM_TCP135

YoucanalsousetheFirewallUserInterfacetoopentheport.

Procedure1. IntheControlPanel,double-clickWindowsFirewall.2. ClickChangeSettings,andthenclicktheExceptionstab.3. IntheExceptionswindow,selectthecheckboxforDCOMtoenableDCOMtraffic

throughthefirewall.Ifthereisnosuchcheckbox,youcana. ClickAddPort.b. Inthedialogbox,enterNameasDCOMandPortnumberas135.EnsurethatTCPis

selected.c. ClickOK.

IBMUnstructuredData751, p. 189

Page 199: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ConfiguringIBMInformationArchiveRetentionServersBeforeyoucreateretentionvolumes,youneedtoconfiguresettingsonyourIBMInformationArchiveretentionserver.Filesthataresenttoretentionmusthaveacorrespondingmanagementclasstomanagetheretentionperiodsettings.Theseclassesrequireadefinedclass,policydomain,policyset,andnodeontheIBMInformationArchiveretentionserver.

AboutthistaskUsetheTivoliStorageadministrativeclient,dsmadmc,toentercommands.Youcanusetheadministrativeclientineitherinteractiveorbatchmode.SeeTivoliStorageManagerAdministrator'sReferenceformoredetailsaboutusingtheadministrativeclient.

Procedure1. Createapolicydomain.Forexample,

definedomainExample_PDdesc='ExampleDomain'archret=1

2. Createapolicysetforthepolicydomain.

definepolicysetExample_PDExample_PS

3. Createoneormoremanagementclasses.TheseclassesarereferredtoasRetentionClassesintheapplication’suserinterface.Eachmanagementclasshasonlyonecopygroupthatisassignedtoit.

DefinemgmtclassExample_PDExample_PSExample_MG_CRdesc='ExampleDomainchronologicalretentionmanagementclass’

DefinemgmtclassExample_PDExample_PSExample_MG_0DAYdesc='ExampleDomainzerodayretention'

DefinemgmtclassExample_PDExample_PSExample_MG_10DAYdesc='ExampleDomain10dayretention'

4. Createanarchivecopygroupforeachmanagementclassthatisdefinedbefore.Thecopygroupmustincluderetinit=creation.Forexample,

DefinecopygroupExample_PDExample_PSExample_MG_CRSTANDARDtype=archivedestination=archivepoolretver=1retinit=creation

DefinecopygroupExample_PDExample_PSExample_MG_0DAYSTANDARDtype=archivedestination=archivepoolretver=0retinit=creation

DefinecopygroupExample_PDExample_PSExample_MG_10DAYSTANDARDtype=archivedestination=archivepoolretver=10retinit=creation

5. Assignoneofthemanagementclassesthatarecreatedbeforeasthedefaultmanagementclassforthepolicydomain.

6. AssigndefmgmtclassExample_PDExample_PSExample_MG_CR.7. Completethedefinitionofthepolicydomainbyvalidatingandactivatingthepolicyset.8. ValidatepolicysetExample_PDExample_PS.9. ActivatepolicysetExample_PDExample_PS.10. Createanode.ItactsasaconnectionbetweenIBM®StoredIQPlatformandtheserver

andisusedwhenyoudefineIBMStoredIQPlatformvolumes.Forexample,

registernodeExampleDomainpassworddomain=Example_PD

Note:Youcanalsousethequerynodecommandtolistnodes.

Parenttopic:Configurationofretentionservers

IBMUnstructuredData751, p. 190

Page 200: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

RelatedconceptsConfigurationofretentionserversNetAppSnapLockHitachiHCAPconfigurationrequirements

IBMUnstructuredData751, p. 191

Page 201: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

NetAppSnapLockWhenyouconfigureNetAppSnapLockasaretentionserver,certainconfigurationrequirementsmustbemet.

Note:UseIBM®StoredIQPlatformtomanagefiles:NetAppSnapLockretentionserversdonotlockoutuserdeletionandmodificationoffilesthatdonothaveanactiveretentionperiod.AlwaysuseIBMStoredIQPlatformtomanagefilesonretention.

WhenyoupreparetoaddSnapLockretentionvolumes,youmusthavelicensedSnapLock.YoumustcreateatleastoneSnapLockvolumeandshareitusingeitherWindowsShareorNFS(orboth),andinitializetheSnapLockcomplianceclock.SeetheNetAppadministratordocumentationforspecificinstructions.

Whenyouconfiguretheserver,settheretentionperiodsettings.Settheminimumsettingtozerowhilenotenteringamaximumsetting.AccesstheSnapLockserverandenterthefollowingcommands:

voloptions<vol-name>SnapLock_minimum_period0dvoloptions<vol-name>SnapLock_default_periodmin

Parenttopic:Configurationofretentionservers

RelatedconceptsConfigurationofretentionserversConfiguringEnterpriseVault

RelatedtasksCreatingCenterapoolsConfiguringtheDellDXObjectStoragePlatformConfiguringIBMInformationArchiveRetentionServersConfiguringFileNetConfiguringChattermessages

IBMUnstructuredData751, p. 192

Page 202: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

HitachiHCAPconfigurationrequirementsInorderforIBM®StoredIQPlatformtoaccesstheHitachiHCAPserver,certainconfigurationrequirementsmustbemet.

TheIBMStoredIQPlatformapplicationaccessestheHitachiHCAPserverwithHTTP.TheHTTPgatewaymustbeenabledontheserver.Dependingonthecurrentallow/denylistsfortheHTTPgateway,youmightneedtoaddtheIBMStoredIQPlatformdataserver'sIPaddressestotheAllowIPaddresseslist.

Parenttopic:Configurationofretentionservers

RelatedconceptsConfigurationofretentionserversConfiguringEnterpriseVault

RelatedtasksCreatingCenterapoolsConfiguringtheDellDXObjectStoragePlatformConfiguringIBMInformationArchiveRetentionServersConfiguringFileNetConfiguringChattermessages

IBMUnstructuredData751, p. 193

Page 203: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

CreatingprimaryvolumesPrimaryvolumescanbecreatedasdatasources.

Procedure1. GotoAdministration>Datasources>Specifyvolumes>Volumes.2. OnthePrimaryvolumelistpage,clickAddprimaryvolumes.3. Entertheinformationthatisdescribedinthefollowingtable,whichisbasedonyour

servertype.4. ClickOKtosavethevolume.5. Selectoneofthefollowingoptions:

Addanothervolumeonthesameserver.Addanothervolumeonadifferentserver.Finishedaddingvolumes.

ThistabledescribesthefieldsthatareavailableintheAddvolumedialogboxwhenyouconfigureprimaryvolumes.

Note:Case-sensitivityrulesforeachservertypeapply.Redasteriskswithintheuserinterfacedenotethefields.

Table1.Primaryvolumes:Fields,requiredactions,andapplicablevolumetypesFieldname

Requiredaction SpecialnotesApplicablevolumetype

ForDocumentum,

CIFS(Windowsplatforms)NFSv2andv3

Exchan

IBMUnstructuredData751, p. 194

Page 204: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Servertype

IntheServertypelist,selecttheservertype.

ForDocumentum,youmustspecifythedocbroker.SeeConfiguringDocumentum.ForDiscoveryAccelerator,youmustfirstcreateaDiscoveryAcceleratorsiteandanEnterpriseVaultsite.ForDomino,youmustfirstuploadatleastoneuser.id.SeeAddingDominoasaPrimaryVolume.ForDesktop,thedesktopagentmustbeinstalledonthatdesktopandthenpointedtothedataserver.DesktopdoesnotappearintheServertypelist.Instead,itappearsasanavailableserverorvolume.ForFileNet,seeConfiguringFileNetForChatter,seeConfiguringChattermessages.

ngeSharePointDocumentumDiscoveryAcceleratorDominoFileNetNewsGatorLivel

inkJiveC

IBMUnstructuredData751, p. 195

Page 205: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Chatter

Version

IntheVersionlist,selecttheappropriateversion.

Exchange

Server

IntheServertextbox,enterthefullyqualifiednameoftheserverwherethevolumeisavailableformounting.

ForExchangeprimaryvolumes,itisthefullyqualifieddomainnamewheretheOWAis.MultipleClientAccessserversonExchange2007aresupported.Theservermustbeload-balancedattheIPorDNSlevel.ForNetApp,selectthepredefinedserverfromthelist.ForDomino,selecttheappropriateusername,whichwasenteredwiththeConfigurationsubtabintheLotusNotesuseradministrationarea.WhenyouaddSharePointvolumesthatcontainspacesintheURL,see

SpecialNote:AddingSharePointVolumes.ForDesktop,thedesktopagentmustbeinstalledonthatdesktopandthen

CIFS(Windowsplatforms)NFSv2andv3NetAppExchangeSharePointD

IBMUnstructuredData751, p. 196

Page 206: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

desktopandthenpointedtothedataserver.DesktopdoesnotappearintheServertypelist.Instead,itappearsasanavailableserverorvolume.

DominoFileNetNewsGatorJiveLivelink

Customer

IntheCustomerlist,selectthecustomerforthisvolume.

DiscoveryAccelerator

FileNetconfig

UsetheFileNetconfiglisttoselecttheFileNetserveryouwouldliketouseforthisconfiguration.

Formoreinformation,seeConfiguringFileNet.

FileNet

Mailboxserver

Whenyouconfiguremultipleclientaccessservers,enterthenameofoneormoremailboxservers,whichareseparatedbyacomma.

ForExchangeprimaryvolumes,itisthefullyqualifieddomainnamewherethemailboxtobeharvestedis.

ExchangeEx

change

IBMUnstructuredData751, p. 197

Page 207: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ActiveDirectoryserver

IntheActiveDirectoryservertextbox,enterthenameoftheActiveDirectoryserver.

ItmustbeafullyqualifiedActiveDirectoryserver.

eDiscoveryAcceleratorSharePoint

Protocol TouseSSL,selecttheProtocolcheckbox.

APIclientusesHTTPoverSSLtocommunicatewithDiscoveryAcceleratorServerconfiguration.

ExchangeDiscoveryAcceleratorSharePointNewsG

IBMUnstructuredData751, p. 198

Page 208: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

GatorJive

Docbase

IntheDocbasetextbox,enterthenameoftheDocumentumrepository.

ADocumentumrepositorycontainscabinets,andcabinetscontainfoldersanddocuments.

Documentum

Port InthePorttextbox,enterthenameoftheport.

Livelink

Database

IntheDatabasetextbox,enterthenameofthedatabase.

Livelink

Searchslice

IntheSearchslicetextbox,enterthenameofthesearchslice.

LivelinkCIFS(Windowsplatforms)ExchangeShare

IBMUnstructuredData751, p. 199

Page 209: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Connectas

IntheConnectastextbox,enterthelogonIDthatisusedtoconnectandmountthedefinedvolume.

ForDomino,selecttheusernamefortheprimaryuserID.TheuserIDmustbeconfiguredontheSystemConfigurationscreenundertheLotusNotesuseradministrationlink.

ePointDocumentumDominoDiscoveryAcceleratorFileNetNewsGatorJiveChatterLiv

elinkCI

IBMUnstructuredData751, p. 200

Page 210: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Password

InthePasswordtextbox,enterthepasswordthatisusedtoconnectandmountthedefinedvolume.

ForDomino,enterthepasswordfortheprimaryuserID.

IFS(Windowsplatforms)ExchangeSharePointDocumentumDominoDiscoveryAcceleratorFi

IBMUnstructuredData751, p. 201

Page 211: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

FileNetNewsGatorJiveChatterLivelink

Site IntheSitelist,selectthesiteofthevolume.

DiscoveryAccelerator

Authtoken

IntheAuthtokentextbox,enterthetokenthatisusedtoauthenticatetheChattervolume.

TheauthtokenmustmatchtheusernamethatisusedintheConnectasfield.AuthtokenscanbegeneratedonlineonSalesforce.SeeConfiguringchattermessages.

Chatter

Objectstore

IntheObjectstorelist,selectthewantedobjectstore.

TheobjectstoremustexistbeforethecreationofaFileNetprimaryvolume.

FileNet

CIFS(

IBMUnstructuredData751, p. 202

Page 212: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Volume

IntheVolumetextbox,enterthenameornamesofthevolumetobemounted.

ForExchange,Domino,Documentum,EnterpriseVault(primaryvolume),andNewsGator,enterafriendlynameforthevolume.WhenyouaddSharePointvolumesthatcontainspacesintheURL,seeSpecialNote:AddingSharePointVolumes.

(Windowsplatforms)NFSv2andv3NetAppExchangeSharePointDocumentumDisc

overyAc

IBMUnstructuredData751, p. 203

Page 213: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

cceleratorDominoFileNetNewsGatorJiveChatterLivelink

DiscoveryAcceleratorcase

IntheDiscoveryAcceleratorcasetextbox,enterthenameoftheDiscoveryAccelerator.

ThistextboxispopulatedfromDiscoveryAcceleratorwhenconnectionisestablished.

DiscoveryAccelerator

Scop IntheScopeofdataoptions,selecteitherAll

DiscoveryA

IBMUnstructuredData751, p. 204

Page 214: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Scopeofdata

IntheScopeofdataoptions,selecteitherAlldatainthiscaseorOnlyselectedreviewmarks.

Accelerator

Harvest

ItistheDocumentumharvestoption:Toenableharvesting,selectHarvestalldocumentversions.Toharvestmailboxes,selecttheHarvestmailboxesoption.Toharvestmailjournals,selecttheHarvestmailjournalsoption.Toharvestallapplications,selecttheHarvestallapplicationsoption.

ThisoptionobtainsthelistofallknownDominousersandtheirNSFs.Itthenharveststhosemailboxesunlessitwaspointedtoasinglemailboxwiththeinitialdirectory.

DocumentumDomino

Folders

InFolder,selecteitheroftheMailboxesorPublicfoldersoptions.

Exchange

Withthisfeature,youcanselectavolumefurtherdownthedirectorytree

CIFS(Windowsplatforms)NFSv2an

dv3NetA

IBMUnstructuredData751, p. 205

Page 215: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Initialdirectory

IntheInitialdirectorytextbox,enterthenameoftheinitialdirectoryfromwhichtheharvestmustbegin.

thedirectorytreeratherthanselectinganentirevolume.ForExchange,thisfieldmustbeleftblankifyouareharvestingallmailboxes.Ifyouareharvestingasinglemailbox,entertheemailaddressforthatmailbox.WhenyouaddSharePointvolumesthatcontainspacesintheURL,seeSpecialNote:AddingSharePointVolumes.

AppExchangeSharePointDocumentumFileNetJiveChatterLivelink

Virtualroot

InVirtualroot,changethedefaultnametomatchtheExchangeserverdesignation.

ForExchange,thisoptionmustbechangedtomatchtheserverdesignation.

Exchange

Personalarchives

Toenablethecollectionofpersonalarchives,selecttheHarvestpersonalarchivecheckbox.

ThisoptionpertainsonlytoExchange2010withSP1applied.

Exchange2

IBMUnstructuredData751, p. 206

Page 216: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

2010

Indexoptions

SelecteitherorbothoftheIndexoptionscheckboxes.

Includesystemmetadatafordataobjectswithincontainers.Includecontenttaggingandfull-textindex.

Theseoptionsareselectedbydefault.

CIFS(Windowsplatforms)NFSv2andv3NetAppExchangeSharePointDocumentumD

IBMUnstructuredData751, p. 207

Page 217: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DiscoveryAcceleratorDominoFileNetNewsGatorJiveChatterDesktopLivelink

Subsites

SelectRecurseintosubsites.

Sha

rePoint

IBMUnstructuredData751, p. 208

Page 218: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Versions SelectIncludeallversions.

IBM®StoredIQPlatformsupportsindexingversionsfromSharePoint.Formoreinformation,seeSpecialNote:AddingSharePointVolumes.

SharePointJive

Removejournalenvelope

Whenselected,thejournalenvelopeisremoved.

ExchangeCIFS(Windowsplatforms)NFSv2andv3NetAppExchangeSha

IBMUnstructuredData751, p. 209

Page 219: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Validation

Tovalidatevolumeaccessibility,selectValidation.

Whenselected(thedefaultstate),IBMStoredIQPlatformteststoseewhetherthevolumecanbeaccessed.

arePointDocumentumDiscoveryAcceleratorDominoNewsGatorJiveChatterLivelin

kCIFS

IBMUnstructuredData751, p. 210

Page 220: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

IncludedirectoriesorIncluderesearchfolders

InIncludedirectories,specifyaregularexpressionforincludeddirectoriesforeachharvest(ifitwasspecified).

Thesedirectoriesaredefinedassetsof"firstnode"directories,relativetothespecified(orimplied)startingdirectory,thatisconsideredpartofthelogicalvolume.ForDiscoveryAccelerator,thisregularexpressionhelpsrestrictthevolumetooneormoreResearchFoldersinthecase.

S(Windowsplatforms)NFSv2andv3NetAppExchangeSharePointDocumentumDiscoveryAc

IBMUnstructuredData751, p. 211

Page 221: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

cceleratorDominoFileNetJiveChatterDesktopLivelink

CIFS(Windowsplatforms)NFSv2andv

IBMUnstructuredData751, p. 212

Page 222: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Startdirectory

InStartdirectory,designateastartdirectoryfortheharvest.Thestartdirectoryinvolvesvolumepartitioningtobreakupalargevolume.Ifaninitialdirectoryisdefined,thestartdirectorymustbeunderneaththeinitialdirectory.Forexample,inthecaseofdirectoriesE-H,EwouldbethestartdirectoryandHwouldbetheenddirectory.

v3NetAppExchangeSharePointDominoFileNetJiveChatterLivelinkCIFS(Windowsplatforms)

IBMUnstructuredData751, p. 213

Page 223: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Enddirectory

InEnddirectory,determinetheenddirectoryfortheharvest.Theenddirectoryisalsopartofvolumepartitioningandisthelastdirectoryharvested.

s)NFSv2andv3ExchangeNetAppSharePointDominoFileNetJiveChatterLivelink

C

IFS(Win

IBMUnstructuredData751, p. 214

Page 224: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

AccessTimes

InAccesstimes,selectoneoftheseoptions:Resetaccesstimesbutdonotsynchronizethem.(Thissettingisthedefaultsetting.)Donotresetorsynchronizeaccesstimes.Resetandsynchronizeaccesstimesonincrementalharvests.

indowsplatforms)NFSv2andv3NetAppDominoCIFS(Windowsplatforms)NFSv2andv3NetAp

IBMUnstructuredData751, p. 215

Page 225: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

VolumeconstraintsorConstraints

InConstraints,selectoneoftheseoptions:Onlyuse__connectionprocess(es):Specifyalimitforthenumberofharvestconnectionstothisvolume.Iftheserverisalsobeingaccessedforattributeandfull-textsearches,youmightwanttoregulatetheloadontheserverbylimitingtheharvesterprocesses.Themaximumnumberofharvestprocessesisautomaticallyshown.Thismaximumnumberissetonthesystemconfigurationtab.Controlthenumberofparalleldataobjectreads:Designatethenumberofparalleldataobjectreads.Scopeharvestsonthesevolumesbyextension:Includeorexcludedataobjectsthatarebasedonextension.

TheScopeharvestsonthesevolumesbyextensionoptionpertainsonlytothesevolumetypes:

WindowsShareNFSv2andv3NetAppCelerraDiscoveryAccelerator

ppExchangeDominoSharePointDocumentumDiscoveryAcceleratorFileNetJiveC

hatterDe

IBMUnstructuredData751, p. 216

Page 226: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

esktopLivelink

ConfiguringExchange2007ClientAccessServersupportThesystemsupportstheharvestofmultipleClientAccessServers(CAS)whenyouconfigureExchange2007primaryvolumes.ThisfeaturedoesnotsupportredirectiontootherCAS/Exchangeclustersorautodiscoveryprotocol.AddingDominoasaprimaryvolumeDominovolumescanbeaddedasprimaryvolumes.Specialnote:SharePointvolumesCertainfieldsmustbeconfiguredwhenSharePointvolumesareadded.ConfiguringFileNetByprovidingtheconfigurationvaluesforaFileNetdomain,youaresupplyingthevaluesthatareneededtobootstrapintoadomain.ConfiguringChattermessagesWithinChatter,thedefaultadministratorprofiledoesnothavetheManageChatterMessagespermission,buttheappropriatepermissionsarerequiredtoharvestprivatemessages.

Parenttopic:Volumesanddatasources

RelatedconceptsVolumesanddatasourcesSpecialnote:SharePointvolumes

RelatedtasksConfiguringExchange2007ClientAccessServersupportAddingDominoasaprimaryvolumeConfiguringprimaryvolumesbyusingEnterpriseVault

IBMUnstructuredData751, p. 217

Page 227: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ConfiguringExchange2007ClientAccessServersupportThesystemsupportstheharvestofmultipleClientAccessServers(CAS)whenyouconfigureExchange2007primaryvolumes.ThisfeaturedoesnotsupportredirectiontootherCAS/Exchangeclustersorautodiscoveryprotocol.

Procedure1. GotoAdministration>Datasources>Volumes>Primary>Addprimaryvolumes.2. IntheServertypelist,selectExchange.3. IntheVersionlist,select2007.4. IntheServertextbox,typethenameoftheExchangeserver.Thisservermustbeload-

balancedattheIPorDNSlevel.5. IntheMailboxserver:textbox,enterthenameofoneormoremailboxservers,which

areseparatedbyacommaandaspace.6. Completetheremainingfieldsfortheprimaryvolume,andthenclickOK.

Parenttopic:Creatingprimaryvolumes

RelatedconceptsSpecialnote:SharePointvolumes

RelatedtasksCreatingprimaryvolumes

IBMUnstructuredData751, p. 218

Page 228: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

AddingDominoasaprimaryvolumeDominovolumescanbeaddedasprimaryvolumes.

Procedure1. AddaLotusNotesuserbyuploadingitsuserIDfileinLotusNotesUserAdministrationontheAdministration>Configurationtab.

Ifyouwanttoharvestauser’smailbox,addtheuserIDfileforthatuser.Ifyouwanttoharvestmultiplemailboxeswithinonevolumedefinition,addtheadministrator’sIDfile.IfthemailboxeshaveencryptedemailsorNSFs,thenyouneedeachuser’suserIDfiletodecryptauser’sdata.

2. PointthevolumetotheDominoserver.Ifasinglemailboxmustbeharvested,settheinitialdirectorytobethepathtothemailboxontheDominoserver,suchasmail\USERNAME.

3. Toharvestmailboxes,selecttheHarvestmailboxesoption,whichobtainsthelistofallknownDominousersandtheirNSFs.Itthenharveststhosemailboxesunlessitwaspointedtoasinglemailboxbyusingtheinitialdirectory.

4. Toharvestallmailjournals,selecttheHarvestmailjournalsoption.5. Toharvestallmailapplications,selecttheHarvestallapplicationsoption,whichlooksatallNSFs,includingmailjournals,ontheDominoserver.

Parenttopic:Creatingprimaryvolumes

RelatedconceptsSpecialnote:SharePointvolumes

RelatedtasksCreatingprimaryvolumes

IBMUnstructuredData751, p. 219

Page 229: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Specialnote:SharePointvolumesCertainfieldsmustbeconfiguredwhenSharePointvolumesareadded.

IBM®StoredIQPlatformsupportstheentiresitesportionofaSharepointURLforthevolume/sites/main_site/sub_siteintheVolumefieldwhenyouaddaSharePointvolume.However,iftheSharePointvolumeURLcontainsspaces,thenyoumustalsousetheServer,Volume,andInitialdirectoryfieldsintheAddvolumedialogboxinadditiontotherequiredfieldsServertype,Server,Connectas,andPassword.Forexample,theSharePointvolumewiththeURLhttp://shpt2010.reglab5.local/sitestest/autoteamsite1/AttributeHarvestWikiPagesLibrary/wouldrequirethefieldsinthefollowingtablebecauseofthespacesintheURL.

Table1.SharePointvolumesasprimaryvolumes:Fieldsandexamples

Primaryvolumefield ExampleServer shpt2010.reglab5.localVolume /sitestest/autoteamsite1Initialdirector AttributeHarvestWikiPagesLibrary

PerformanceconditionsforusingversionsWhenyouaddaprimaryvolume,youdefinethevolumebysettingcertainproperties.IfaSharePointvolumeisadded,youhavetheoptionofindexingdifferentversionsofdataobjectsonthatvolume.

Sincemostversionsofanyobjectsharesfull-textcontentandattributes,Theeffortinprocessingthemandmaintaininganupdatedcontextfortheversionhistoryofanobjectintheindexisduplicated.Additionally,ifyouenableversionfeatureonaSharePointvolume,theAPIitselfcausesextraoverheadinfetchingdataandmetadataforolderversions.

Foreachobject,anextraAPIcallmustbemadetogetalistofallitsversions.Tofetchattributesfortheolderversionsofanobject,anAPIcallmustbemadeforeachattributethatneedstobeindexed.

Parenttopic:Creatingprimaryvolumes

RelatedtasksCreatingprimaryvolumesConfiguringExchange2007ClientAccessServersupportAddingDominoasaprimaryvolumeConfiguringprimaryvolumesbyusingEnterpriseVault

IBMUnstructuredData751, p. 220

Page 230: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ConfiguringFileNetByprovidingtheconfigurationvaluesforaFileNetdomain,youaresupplyingthevaluesthatareneededtobootstrapintoadomain.

Procedure1. GotoAdministration>Datasources>SpecifyServers>FileNetdomainconfigurations.2. ClickAddnewFileNetdomainconfigurationTheFileNetdomainconfigurationeditor

pageappears.3. IntheFileNetdomainconfigurationeditorpage,configurethesefields:

a. IntheConfigurationnametextbox,entertheconfigurationnameforthisserver.b. IntheServernametextbox,entertheservername.c. IntheConnectionlist,selecttheconnectiontype.d. InthePorttextbox,entertheportnumber.e. InthePathtextbox,enterthepathforthisserver.f. IntheStanzatextbox,enterthestanzainformationforthisserver.

4. ClickOKtosaveyourchanges.

Parenttopic:Creatingprimaryvolumes

RelatedconceptsConfigurationofretentionserversNetAppSnapLockHitachiHCAPconfigurationrequirements

IBMUnstructuredData751, p. 221

Page 231: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ConfiguringChattermessagesWithinChatter,thedefaultadministratorprofiledoesnothavetheManageChatterMessagespermission,buttheappropriatepermissionsarerequiredtoharvestprivatemessages.

BeforeyoubeginAusermusthavecertainadministrativepermissionswhenthatuseraccountisusedintheConnectastextboxinChatter.WhenyousetupaChatteruseraccounttoharvestandrunactionsagainstChatter,youmustuseanaccountwiththebuilt-insystemadministratorprofile.Ingeneral,however,theseadministrativepermissionsmustbeassignedtotheaccountyouuse:

APIenabledManagerChatterMessages(requiredifyouwanttoharvestChatterPrivateMessages)ManageUsersModerateChatterViewAllData

ProcedureForChatteradministratorswhousetheAuthtokenoption,seehowtosetupasandboxaccount.

Parenttopic:Creatingprimaryvolumes

RelatedconceptsConfigurationofretentionserversNetAppSnapLockHitachiHCAPconfigurationrequirements

IBMUnstructuredData751, p. 222

Page 232: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

CreatingretentionvolumesRetentionvolumesstoredataobjectsthatareplacedunderretention.Itmeansthattheobjectisretained.

Procedure1. Configureyourretentionservers.2. Createmanagementorretentionclasses,or,ifyouareusingCenteraretentionservers,

createCenterapools.3. IfyouareusingEnterpriseVault,ensurethatyoudefinedEnterpriseVaultSites.You

mightalsowanttodefineRetentionCategoriesontheEnterpriseVaultserver.4. Createretentionvolumes.

AddingaretentionvolumeRetentionvolumescanbeaddedandconfigured.ConfiguringEnterpriseVaultretentionvolumesEnterpriseVaultretentionvolumescanbeconfiguredonanas-neededbasis.

Parenttopic:Volumesanddatasources

RelatedconceptsVolumesanddatasources

RelatedtasksAddingaretentionvolumeConfiguringEnterpriseVaultretentionvolumes

IBMUnstructuredData751, p. 223

Page 233: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

AddingaretentionvolumeRetentionvolumescanbeaddedandconfigured.

Procedure1. GotoAdministration>Datasources>Volumes,andthenclickRetention.2. Dependingonthetypeofretentionserveryouareadding,completethefieldsas

describedinthistable.3. ClickOKtosavethevolume.

Note:Case-sensitivityrulesapply.Redasteriskswithintheuserinterfacedenoterequiredfields.

Table1.Retentionvolume:Fields,requiredactions,andapplicablevolumetypesFieldname

RequiredactionSpecialnotes

Applicablevolumetype

WindowsShare(CIFS)NFSv3CenteraHitachiIB

MInformatio

IBMUnstructuredData751, p. 224

Page 234: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Servertype

IntheServertypelist,selecttheservertype.

ionArchiveDellDXStorageEnterpriseVaultNetAppSnapLockNetApp

Platform InthePlatformlist,selecttheplatformtype.

Standard

PoolInthePoollist,selecttheStoredIQpoolprofilenametoprovideaccesstoaspecificCenterapool.

Centera

IBMUnstructuredData751, p. 225

Page 235: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Site IntheSitelist,selecttheappropriatesite.

Vaultstore

IntheVaultstorelist,selectthewantedvaultstoreforthevolume.

DellDXStorageCluster

IntheDellDXStorageClusterlist,selecttheappropriateDellDXStorageCluster.

Server

IntheServertextbox,assigntheserveraname.

WindowsShare(CIFS)NFSv3HitachiIBMInformation

ArchiveNet

IBMUnstructuredData751, p. 226

Page 236: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

etAppSnapLock

Nodename

IntheNodenametextbox,enterthenameofthenode.

IBMInformationArchive

Nodeport

IntheNodeporttextbox,enterthenode'sportnumber.

IBMInformationArchive

Nodepassword

IntheNodepasswordtextbox,enterthepasswordforthenode.

IBMInformationArc

hiveWind

IBMUnstructuredData751, p. 227

Page 237: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Connectas

IntheConnectastextbox,entertheloginID.

owsShare(CIFS)IBMInformationArchive

Password

InthePasswordtextbox,enterthepasswordfortheloginID.

WindowsShare(CIFS)IBMInformationArchiveN

IBMUnstructuredData751, p. 228

Page 238: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

NetAppSnapLock

Volume

IntheVolumetextbox,enterthenameornamesofthevolumetobemounted.

WindowsShare(CIFS)NFSv3CenteraHitachiIBMInformat

ionArchive

IBMUnstructuredData751, p. 229

Page 239: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

eDellDXStorageNetAppSnapLock

Indexopti

SelecteitherorbothoftheIndexoptionscheckboxes.Includesystemmetadatafordataobjectswithincontainers.

Theseoptionsareselect

WindowsShare(CIFS)NFSv3CenteraHitachiIBMIn

IBMUnstructuredData751, p. 230

Page 240: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

options

Includesystemmetadatafordataobjectswithincontainers.Includecontenttaggingandfull-textindex.

selectedbydefault.

InformationArchiveDellDXStorageNetAppSnapLock

Matterarchivename

IntheMatterarchivenametextbox,enterthenameofthematterarchive.

EnterpriseVault

Description

IntheDescriptiontextbox,enteradescription.

Enterpri

seVault

IBMUnstructuredData751, p. 231

Page 241: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Defaultretentioncategory

IntheDefaultretentioncategorylist,selectthedefaultretentioncategory.

Retentioncategoryoverride

SelecttheAllowretentioncategorytobeoverriddenonpolicy.

Constraints

InConstraints,selecteitherorbothoftheseoptions:Onlyuse__connectionprocess(es):Specifyalimitforthenumberofharvestconnectionstothisvolume.Iftheserverisalsobeingaccessedforattributeandfull-textsearches,youmightwanttoregulatetheloadontheserverbylimitingtheharvesterprocesses.Themaximumnumberofharvestprocessesisautomaticallyshown.Thismaximumnumberisset

WindowsShare(CIFS)NFSv3CenteraHitachiIBMIn

formationA

IBMUnstructuredData751, p. 232

Page 242: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

processesisautomaticallyshown.Thismaximumnumberissetonthesystemconfigurationtab.Controlthenumberofparalleldataobjectreads:Designatethenumberofparalleldataobjectreads.

ArchiveDellDXStorageNetAppSnapLockEnterpriseVault

Parenttopic:Creatingretentionvolumes

RelatedtasksCreatingretentionvolumes

IBMUnstructuredData751, p. 233

Page 243: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ConfiguringEnterpriseVaultretentionvolumesEnterpriseVaultretentionvolumescanbeconfiguredonanas-neededbasis.

Procedure1. GotoAdministration>Datasources>Volumes>Retention.2. ClickAddretentionvolumes.3. IntheServertypelist,selectEnterpriseVault.4. InthenSitelist,selecttheEnterpriseVaultsiteyoucreated.SeeEnterpriseVault.5. EntertheinformationdescribedinCreatingRetentionVolumes,basedonyourserver

type.6. ClickOKtosavethevolume.7. Selectoneofthefollowing:

AddanothervolumeonthesameserverAddanothervolumeonadifferentserverFinishedaddingvolumes

Parenttopic:Creatingretentionvolumes

RelatedtasksCreatingretentionvolumes

IBMUnstructuredData751, p. 234

Page 244: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

CreatingdiscoveryexportvolumesDiscoveryexportvolumescontainthedataproducedfromapolicy,whichiskeptsothatitcanbeexportedasaloadfileanduploadedintoalegalreviewtool.Administratorscanalsoconfigurediscoveryexportvolumesformanagingharvestresultsfromcyclesofadiscoveryexportpolicy.

Procedure1. GotoAdministration>Datasources>Specifyvolumes,andthenclickVolumes.2. ClickDiscoveryexport,andthenclickAdddiscoveryexportvolumes.3. Entertheinformationdescribedinthetablebelow,andthenclickOKtosavethevolume.

Note:Case-sensitivityrulesforeachservertypeapply.Redasteriskswithintheuserinterfacedenoterequiredfields.Table1.Discoveryexportvolumes:fields,requiredactions,andapplicablevolumetypes.Field

RequiredactionApplicablevolumetype

Servertype

UsingtheServertypelist,selectthetypeofserver.

CIFS(Windowsplatforms)NFSv2,v3

Serve

IntheServertextbox,enterthenameoftheserverwherethevolumeisavailableformounting.

CIFS(Windowsplatfo

IBMUnstructuredData751, p. 235

Page 245: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

r rms)NFSv2,v3

Connectas

IntheConnectastextbox,enterthelogonIDusedtoconnectandmountthedefinedvolume.

CIFS(Windowsplatforms)

Password

InthePasswordtextbox,enterthepasswordusedtoconnectandmountthedefinedvolume.

CIFS(Windowsplatforms)

Volume

IntheVolumetextbox,enterthenameofthevolumetobemounted.

CIFS(Windowsplatfo

rm

IBMUnstructuredData751, p. 236

Page 246: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

s)NFSv2,v3

Constraints

ToutilizeConstraints,selectthisoption:Onlyuse__connectionprocess(es):Specifyalimitforthenumberofharvestconnectionstothisvolume.Iftheserverisalsobeingaccessedforattributeandfull-textsearches,youmaywanttoregulatetheloadontheserverbylimitingtheharvesterprocesses.Themaximumnumberofharvestprocessesisautomaticallyshown.ThismaximumnumberissetonthesystemConfigurationtab.

CIFS(Windowsplatforms)NFSv2,v3

Parenttopic:Volumesanddatasources

RelatedconceptsVolumesanddatasources

IBMUnstructuredData751, p. 237

Page 247: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

CreatingsystemvolumesSystemvolumessupportvolumeexportandimport.Whenyouexportavolume,dataisstoredonthesystemvolume.Whenyouimportavolume,dataisimportedfromthesystemvolume.

Procedure1. GotoAdministration>Datasources>Specifyvolumes>Volumes.2. SelecttheSystemtab,andthenclickAddsystemvolumes.3. Entertheinformationdescribedinthetablebelow,andthenclickOKtosavethevolume.

Note:Case-sensitivityrulesapply.Redasteriskswithintheuserinterfacedenoterequiredfields.

Table1.Systemvolumefields,descriptions,andapplicablevolumetypesFieldname

Requiredaction

Specialnotes

Applicablevolumetype

Servertype

UsingtheServertypelist,selectthetypeofserver.

CIFS(Windowsplatforms)NFSv2,v3

Serve

IntheServertextbox,enterthenameoftheserverwherethevolumeisavailableformounting.

CIFS(Windowsplatfo

IBMUnstructuredData751, p. 238

Page 248: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

er fo

rms)NFSv2,v3

Connectas

IntheConnectastextbox,enterthelogonIDusedtoconnectandmountthedefinedvolume.

CIFS(Windowsplatforms)

Password

InthePasswordtextbox,enterthepasswordusedtoconnectandmountthedefinedvolume.

CIFS(Windowsplatforms)

V

olume

IntheVolumetextbox,enterthenameofthevolumetobemounted.

CIFS(Windowsplatforms)

IBMUnstructuredData751, p. 239

Page 249: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

s)NFSv2,v3

Constraints

ToutilizeConstraints,selectthisoption:Onlyuse__connectionprocess(es):Specifyalimitforthenumberofharvestconnectionstothisvolume.Iftheserverisalsobeingaccessedforattributeandfull-textsearches,youmaywanttoregulatetheloadontheserverbylimitingtheharvesterprocesses.Themaximumnumberofharvestprocessesisautomaticallyshown.ThismaximumnumberissetonthesystemConfigurationtab.

CIFS(Windowsplatforms)NFSv2,v3

Parenttopic:Volumesanddatasources

RelatedconceptsVolumesanddatasources

IBMUnstructuredData751, p. 240

Page 250: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Exportandimportofvolumedata

Thesystem’sexportandimportvolumecapabilitiesallowmetadataandfull-textindexeddatatobecollectedorexportedfromseparatelocations,suchasdataserverslocatedinvariousofficesoftheenterprise.Oncethedataisavailable,itcanbeimportedtoasinglelocation,suchasaheadquarter'sofficedataserver,whereselectedfilesmightberetained.

Onlyprimaryandretentionvolumedatacanbeexportedorimportedusingtheexport/importfeature.Discoveryexportandsystemvolumescannotbeimportedorexported.ThetargetlocationofanexportorthesourcelocationofanimportisalwaystheIBM®StoredIQPlatformsystemvolume.

Exportandimportvolumeprocessesrunasjobsinthebackground.Thesejobsareplacedintotheirprospectivequeues,andtheyareexecutedsequentially.Whenonejobcompletes,thenextoneautomaticallystarts.Thesejobscanbecancelledatanytimewhiletheyarerunning.Cancellingoneimportorexportjobalsocancelsallthejobsthatcomeaftertheonecancelled.Becausetheexportjobsandimportjobsresideinseparatequeues,cancellingonetypeofjobdoesnotcanceljobsintheotherqueue.Thejobscannotberestarted.

Parenttopic:Volumesanddatasources

RelatedconceptsVolumesanddatasources

Volumedataexporttoasystemvolume

Whenexportingvolumedatatoasystemvolume,theexportprocesscreatestwofiles:abinaryfileandametadatafile,whichcontainstheexporteddata.

AboutthistaskTheexportprocesscreatestwofiles:abinaryfileandametadatafile,whichcontainstheexporteddata.Thesefiles'namescontainthefollowinginformation:

DataservernameandIPaddressVolumeandservernamesTimestamp

Notethefollowing:

Theexporteddataconsistsofdatafromtheselectedvolumeandanyrelatedinformationthatdescribesthatdatawiththeexceptionofvolume-specificaudits.Theexporteddatahastobemadeavailabletotheimportdataserverbeforeitcanbeimported.Thismayrequireyoutophysicallymovetheexporteddatatothesystemvolumeoftheimportdataserver.Licensesontheimportappliancesareenabledautomaticallyifafeatureoftheimportedvolumerequiresit(suchasCenteraorExchangelicenses).

Procedure1. GotoDSAdmin>Administration>Datasources>Volumes.2. Selectavolumeofdatatoexportfromthelistofvolumesbyclickingtheexportlinkin

thefarright-handcolumn.3. CompletetheExportvolumesdetailsdialog,describedinthistable.4. ClickOK.Adialogappearstoletyouknowthatthedataisbeingexported.5. Tomonitortheexportprogress,clicktheDashboardlink.Tocanceltheexportprocess,

undertheJobsinprogresssectionofthedashboard,clickStopthisjob.Alternately,clickOKtoreturntotheVolumespage.

IBMUnstructuredData751, p. 241

Page 251: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Note:Thejobcannotberestarted.Option DescriptionServer Thenameoftheserverwherethedataresides.Volume Thenameofthevolumewherethedataresides.Exportpath(onsystemvolume)

Thispathiswheretosavethedataonthesystemvolume.Thedefaultpathis/exports.Youcanedittheexportpath.Thespecifiedlocationwillbeautomaticallycreatedifnecessary.

Description(optional) Enteradescriptionoftheexporteddata.

Exportfull-textindex

Selectthisoptiontoexportthevolume’sfull-textindex.(Availableonlyifthevolumehasfull-textindex.)

Volumedataimportfromasystemvolume

Animportedvolumelooks,acts,andis,justlikeavolumeoriginallydefinedandharvestedonthedataserverwithafewkeydifferences.

AboutthistaskForimportedvolumes,anyactionorrelationshipthatisvalidforanon-importedvolumeisvalidforanimportedvolume,withafewexceptions:

Logsandaudittrailsthatcapturetheactivityonthevolumebeforetheimportarenotavailable.However,theimportitselfisaudited.Theimportedvolumecanbereharvestedaslongastheappliancehasthepropernetworkaccessandrightstotheoriginalsourceserverandvolume.Theimportedvolumecanbereharvestedaslongasthedataserverhasthepropernetworkaccessandrightstotheoriginalsourceserverandvolume.Thedataviewerworksonlyiftheappliancehasthepropernetworkaccessandrightstothesourceserverandvolume.Youmusthaveaccessandpermissiononexportserversandvolumesifthefileyouwanttoviewhasbeenmigratedtoasecondaryserveratthetimeoftheexport.

Note:Whenavolumewithalicensedfeatureisimportedintoadataserverthatdoesnotutilizelicensing,thelicenseisimportedalongwiththevolume.Toseethelicensedfeatures,userswillneedtologoutandthenlogbackintothedataserver.

Procedure1. Makesurethatexporteddatafileispresentinthesystemvolumeoftheimport

appliance.2. GotoAdministration>Datasources>Volumes,andthenclickeitherthePrimaryor

Retentiontab.3. ClicktheImportvolumelinkatthetopofeithertheprimaryortheretentionvolume

lists.TheImportvolumespageappears,listingallofthevolumesavailableforimport.Bydefault,thedataserversearchesforavailablevolumestoimportinthe/importsdirectoryofthesystemvolume.Ifyouhaveplacedtheexporteddatatoanotherpath,clickChangepathandentertheappropriatepath.

4. ClickOK.TheImportvolumespagenowdisplaysthefollowinginformationabouttheimportedvolumes.Seethetablebelow.

5. Fromthelistofvolumes,selectavolumetoimportbyclickingtheImportlinkinthelastcolumnontheright.

6. SelecttheImportfull-textindexcheckboxtoimporttheselectedvolume'sfull-textindex.(Thecheckboxisactiveonlyiffull-textindexisavailable.)

7. SelecttheOverwriteexistingvolumecheckboxtoreplacetheexistingdataofthevolumewiththeimporteddata.

8. ClickOK.Adialogappearstoletyouknowthatthevolumeisbeingimported.TheOKbuttonisnotenabledifthevolumealreadyexistsandunlesstheOverwriteexisting

IBMUnstructuredData751, p. 242

Page 252: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

volumeoptionisselected.9. Toviewimportprogress,clicktheDashboardlinkinthedialog.Tocanceltheimport

process,undertheJobsinprogresssectionofthedashboard,clickStopthisjob,orclickOKtoreturntotheManagevolumespage.Option DescriptionServerandvolume

Theservernameandvolumenamewherethedataphysicallyresides.

Description Adescriptionaddedwhenthevolumewasexported.Volumetype Thetypeofvolume,namelyExchange,SharePoint,andsoon.Category Thisisthecategoryofvolume,namelyPrimaryorRetention.

Exportedfrom TheservernameandIPaddressoftheserverfromwhichthedatawasexported.

Exportdate Thedayandtimethedatawasexported.Totaldataobjects Thetotalnumberofdataobjectsexportedfortheexportedvolume.

Containsfull-textindex

Indicateswhetherornotthefull-textindexoptionwaschosenwhenthedatawasexported.

IBMUnstructuredData751, p. 243

Page 253: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DeletingvolumesAdministratorscandeletevolumesfromthelistofavailabledatasources,providedthatthedataserverisconnectedtothegateway.

AboutthistaskNotethefollowingregardingdeletedvolumes:

Deletedvolumesareremovedfromtargetsets.Deletedvolumesareremovedfromallvolumelists,bothfromIBM®StoredIQPlatformandIBMStoredIQAdministrator.Withincreatedjobs,stepsthatreferencedeletedvolumesareimplicitlyremoved,meaningthatajobcouldcontainnosteps.Thejobitselfisnotdeleted.ApplicableobjectcountsandsizeswithinIBMStoredIQAdministratoradjustautomatically.Objectcountsandsizeswithinuserinfosetswillremainthesame.Remember,thoseuserinfosetswerecreatedataspecificpointintimewhenthisdatasourcewasstillavailable.Usersexploringaspecificdatasourceandanygeneratedreportswillnolongerreferencethedeletedvolume.Noexceptionsisraisedonpreviouslyexecutedactions.Instead,thedataisnolongeravailable.Forexample,ifaninfosetiscopiedthatcontaineddataobjectsfromavolumethathasbeendeleted,noexceptionisraised.Ifyoumarkadesktopvolumefordeletion,itisautomaticallyremovedfromthePrimaryvolumelist;however,thestatusofthatworkstationissettouninstallinthebackground.Whenthedesktopclientnextchecksin,itwillseethatchangeinstatusanduninstallitself.

Note:IfretentionvolumessuchasCentera,Hitachi,andsooncontaindata,theycannotbedeletedasIBMStoredIQPlatformisthesourceofrecord.Instead,youseetheUnderManagementlink.

Todeleteavolume:

Procedure1. GotoAdministration>Datasources>Specifyvolumes>Volumes.2. Clickthetabofthevolumetypeyouwouldliketodelete:Primary,Retention,System,orDiscoveryexport.

3. ClickDelete,andintheconfirmationdialog,clickOK.Thevolumeisdeleted,removingitfromthelistofavailablevolumes.

Parenttopic:Volumesanddatasources

RelatedconceptsVolumesanddatasources

IBMUnstructuredData751, p. 244

Page 254: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

PolicylimitationsforvolumetypesVolumetypeshavedifferentpolicylimitations.

IBM®StoredIQimposessomepolicylimitationsonvolumetypes,whichareidentifiedinthistable.

Table1.PolicylimitationsforvolumetypesPolicytype Source/TargetLimitations Otherrestrictions

Copyfrom

CenteraWindowsShareSnapLockNFSSnapLockHitachiIBMInformationArchiveWindowsShareNFSDocumentumSharePointExchangeEnterpriseVault(DiscoveryAccelerator)DellDXStorageNewsGator

Copyto

PrimaryVolume

CIFSNFSSharePointDocumentumFileNet

RetentionVolume

CenteraNetAppSnapLock(CIFS/NFS)CIFSCelerraFLR(CIFS/NFS)DellDXObjectStoreCIFSNFSDocumentum/wRPSHitachiHCAPIBMInformationArchiveSymantecEnterpriseVault

Copyto(retention)

CenteraWindowsShareSnapLockNFSSnapLockHitachiIBMInformationArchiveWindowsShareNFSDocumentumEnterpriseVaultDellDXStorage

CenteraWindowsShareSnapLock

IBMUnstructuredData751, p. 245

Page 255: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Discoveryexportfrom

WindowsShareSnapLockNFSSnapLockHitachiIBMInformationArchiveWindowsShareNFSDocumentumSharePointExchangeEnterpriseVault(DiscoveryAcceleratorDellDXStorageNewsGator

Discoveryexportto

WindowsShareNFS

Considereddiscoveryexportvolumes(category)notharvested

Movefrom

CenteraWindowsShareSnapLockNFSSnapLockHitachiIBMInformationArchiveWindowsShareNFSDocumentumDellDXStorage

Moveto

CenteraWindowsShareSnapLockNFSSnapLockHitachiIBMInformationArchiveWindowsShareNFSDocumentumSharePointDellDXStorage

Delete

CenteraWindowsShareSnapLockNFSSnapLockHitachiIBMInformationArchiveWindowsShareNFSDocumentumDellDXStorage

Modifysecurity CIFS Choosesinglevolume(novolumesets)

Parenttopic:Volumesanddatasources

RelatedconceptsVolumesanddatasources

IBMUnstructuredData751, p. 246

Page 256: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

IBMUnstructuredData751, p. 247

Page 257: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DataharvestingHarvesting(orindexing)istheprocessortaskbywhichIBM®StoredIQPlatformexaminesandclassifiesdatainyournetwork.

RunningaHarvesteveryvolumejobindexesalldataobjectsonallvolumes.

Afullharvestcanberunoneveryvolumeoronindividualvolumes.Anincrementalharvestonlyharveststhechangesontherequestedvolumes

Theseoptionsareselectedwhenyoucreateajobfortheharvest.Aharvestmustberunbeforeyoucanstartsearchingfordataobjectsortextualcontent.AnAdministratorinitiatesaharvestbyincludingaharveststepinajob.

MostharvestingparametersareselectedfromtheConfigurationsubtab.Youcanspecifythenumberofprocessestouseduringaharvest,whetheraharvestmustcontinuewhereitleftoffifitwasinterruptedandmanyotherparameters.Severalstandardharvesting-relatedjobsareprovidedinthesystem.

Harvestingwithandwithoutpost-processingYoucanseparateharvestingactivitiesintotwosteps:theinitialharvestandharvestpost-processing.TheseparationoftasksgivesAdministratorstheflexibilitytoscheduletheharvestorthepost-processloadingtorunattimesthatdonotaffectsystemperformanceforsystemusers.Theseusersmight,forexample,berunningqueries.Hereareexamplesofpost-harvestactivities:

Loadingallmetadataforavolume.Computingalltagsthatareregisteredtoaparticularvolume.Generatingallreportsforthatvolume.Ifconfigured,updatingtags,andcreatingexplorersintheharvestjob.

IncrementalharvestsHarvestingvolumestakestimeandtaxesyourorganization'sresources.Youcanmaintaintheaccuracyofthemetadatarepositoryquicklyandeasilywithincrementalharvests.Withbothofthesefeatures,youcanensurethatthevocabularyforallvolumesisconsistentanduptodate.Whenyouharvestavolume,youcanspeedupsubsequentharvestsbyonlyharvestingfordataobjectsthatwerechangedorarenew.Anincrementalharvestindexesnew,modified,andremoveddataobjectsonyourvolumesorfileservers.Becausetheharvestsareincremental,ittakeslesstimetoupdatethemetadatarepositorywiththeadditionaladvantageofputtingalighterloadonyoursystemsthantheoriginalharvests.

Note:HarvestingNewsGatorVolumes:SinceNewsGatorobjectsarejusteventsinastream,anincrementalharvestofaNewsGatorvolumefetchesonlyneweventsthatwereaddedsincethelastharvest.Tocovergapsduetoexceptionsortopickupdeletedevents,afullharvestmightberequired.

HarvestingpropertiesandlibrariesWhenharvestingprivateinformation,SharePointvolumesmustuseadministrativerolesformountingpermission.LightweightharvestparametersettingsToconductalightweightharvest,certainconfigurationchangescanbemade.

IBMUnstructuredData751, p. 248

Page 258: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

HarvestingpropertiesandlibrariesWhenharvestingprivateinformation,SharePointvolumesmustuseadministrativerolesformountingpermission.

Note:Administrativepermissionsarerequiredtoharvestpersonalinformation,libraries,andobjectsthatarenotdesignatedasbeingvisibletoEveryoneforuserprofiles.

TheSharePointvolumeneedstobemountedwithadministrativepermissions.Iftheharvestisconductedwithoutadministrativepermissions,thenanyoftheuserprofile’spropertiesthatweremarkedasvisibletothecategoryotherthanEveryoneisnotvisibleinresults.Toharvestusers’personaldocumentsandinformation,volumesmountedwithoutadministrativepermissionsmustusecredentialsthathavefullcontrolonallSharePointsitecollections.Thesecollectionsarehostedbytheuserprofileserviceapplication.

Tooverridethisrestriction,seehttp://technet.microsoft.com/en-us/library/ee721057.aspx.

Parenttopic:Dataharvesting

RelatedconceptsDataharvestingLightweightharvestparametersettings

IBMUnstructuredData751, p. 249

Page 259: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

LightweightharvestparametersettingsToconductalightweightharvest,certainconfigurationchangescanbemade.

WithIBM®StoredIQPlatform,youcanconductmanytypesofharvests,dependingonyourdataneeds.Whilein-depthharvestsarecommon,therearealsoinstanceswhereyouneedanoverviewofthedataandasystemwidepictureoffiles’typesandsizes.Forexample,atthebeginningofadeployment,youmightwanttoobtainahigh-levelviewofasubstantialamountofdata.Ithelpsmakebetterdecisionsabouthowyouwanttohandleharvestingorotherpoliciesinthefuture.Thefollowingsectionprovidespossiblesystemconfigurationsforthesystemtoprocessthevolumes’datainthequickestmannerpossible.

DeterminingvolumeconfigurationsettingsToconductalightweightharvest,youcanmakevariousconfigurationchanges.DeterminingharvesterconfigurationsettingsWhenyouconductalightweightharvest,youcanmakecertainharvesterconfigurationchanges.Determiningfull-textsettingsWhenyouconductalightweightharvest,youcanmakefull-text-indexsettingconfigurationchanges.DetermininghashsettingsWhenyouconductalightweightharvest,youcanmakecertainhash-settingconfigurationchanges.

Parenttopic:Dataharvesting

RelatedconceptsDataharvestingHarvestingpropertiesandlibraries

RelatedtasksDeterminingvolumeconfigurationsettingsDeterminingharvesterconfigurationsettingsDeterminingfull-textsettingsDetermininghashsettings

IBMUnstructuredData751, p. 250

Page 260: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DeterminingvolumeconfigurationsettingsToconductalightweightharvest,youcanmakevariousconfigurationchanges.

AboutthistaskVolumeDetails:Whenyouconfiguredatasourcesforalightweightharvest,youdonotneedtoincludecontenttaggingandfull-textindexes.Byclearingthisoption,thesystemindexesthefiles’metadata,nottheentirecontentofthosefiles.Thesystemcanthenrunandcompleteharvestsquickly.Youcanobtainmuchinformationaboutfiletypes,thenumberoffiles,theageofthefiles,fileownership,andotherinformation.

Procedure1. GotoAdministration>Datasources>Specifyvolumes>Volumes.2. OnthePrimaryvolumelistpage,clickAddprimaryvolumesorEdittoeditanexisting

volume.3. VerifythatalloftheIndexoptionscheckboxesarecleared(someareselectedby

default).4. ClickOKandthenrestartservices.

ShowAdvancedDetails:Insomecases,youmightwanttoreducetheweightofafull-textharvest.Intheseinstances,youcanadjusttheprocessingthatisinvolvedwiththevariousharvestconfigurationcontrols.Withinvolumeconfiguration,theadvancedsettingsareusedtocontrolwhatisharvestedwithinthevolume.Byharvestingonlythedirectorystructuresthatyouareinterestedin,youcanexercisesomecontrolovertheharvest’sweight.

IncludeDirectory:Ifyouwanttoharvestasubtreeofthevolumeratherthanthewholevolume,thenyoucanenterthedirectoryhere.Iteliminatestheharvestofobjectsthatarenotrelevanttoyourproject.StartDirectory/EndDirectory:Youcanselectabeginningandendrangeofdirectoriesthatareharvested.Enterthestartandenddirectories.Constraints/Scopeharvestbyextension:Youcanlimitthefilesthatareharvestedthroughconnectionprocesses,paralleldataobjects,orscopingharvestsbyextension.Forexample,withtheScopeharvestbyextensionsetting,youcanlimitthefilesthatyouharvestbyusingasetofextensions.IfyouwanttoharvestonlyMicrosoftOfficefiles,youcanconstraintheharvestto.DOC,.XLS,and.PPTfiles.ItmustbedonefromtheConfigurationtab.

Parenttopic:Lightweightharvestparametersettings

RelatedconceptsLightweightharvestparametersettings

IBMUnstructuredData751, p. 251

Page 261: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DeterminingharvesterconfigurationsettingsWhenyouconductalightweightharvest,youcanmakecertainharvesterconfigurationchanges.

Procedure1. DetermineSkipContentProcessingsettings.

Note:Thissettingisrelevantonlyforfull-textharvests.Youmighthavemanyfilesthataretypesforwhichyoudonotneedthecontentssuchas.EXEfiles.Intheseinstances,youcanaddthesefiletypestothelistoffilesforwhichthecontentisnotprocessed.Therearetwopointstoconsiderwhentoskipcontentprocessing:

Youdonotspendtimeharvestingunnecessaryobjects,whichcanbebeneficialfromatime-savingperspective.Later,youhavetheoptionofviewingthecontentoftheskippedfiles.Itcreatesmorework,reharvestingtheseskippedfiles.

2. DeterminewhichLocationstoignore.

Theremightbeinstanceswherelargequantitiesofdataarecontainedinsubdirectories,andthatdataisnotrelevanttoyourharveststrategy.Forexample,youmighthaveadirectorywithatreeofsourcecodeorsoftwarearchivethatisnotusedasacompanywideresource.Inthesecases,youcaneliminatethesedirectoriesfromtheharvestsbyaddingthedirectorytotheLocationstoignore.Theselocationsarenotspecifictoavolume,butcaninsteadbeusedforcommondirectoriesacrossvolumes.

3. DetermineLimits.Maximumdataobjectsize:Thissettingisonlyrelevantforfull-textharvests.Incasesmanylargefiles,youmightwanttoeliminateprocessingthosefilesbysettingtheMaximumdataobjectsizetoasmallernumber.Thedefaultvalueis1,000,000,000.Youcanstillcollectthemetadataonthelargefiles,soyoucansearchforthemanddeterminewhichfilesweremissedduetothesettingofthisparameter.

4. DetermineBinaryProcessing.

Ifthestandardprocessingcannotindexthecontentsofafile,binaryprocessingisextraprocessingthatcanbeconducted.Forlightweightharvests,theRunbinaryprocessingwhentextprocessingfailscheckboxmustbeclearedasthissettingisonlyrelevantforfull-textharvests.

Parenttopic:Lightweightharvestparametersettings

RelatedconceptsLightweightharvestparametersettings

IBMUnstructuredData751, p. 252

Page 262: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Determiningfull-textsettingsWhenyouconductalightweightharvest,youcanmakefull-text-indexsettingconfigurationchanges.

Procedure1. DetermineLimits.LimitthelengthofwordstobeharvestedbyselectingtheLimitthe

lengthofwordsindexto__charactersoption.Thedefaultvalueis50,butyoucanreducethisnumbertoreducethequantityofindexedwords.

2. DetermineNumbers.Iftherearelargequantitiesofspreadsheetfiles,youcancontrolwhatnumbersareindexedbythesystem.

Parenttopic:Lightweightharvestparametersettings

RelatedconceptsLightweightharvestparametersettings

IBMUnstructuredData751, p. 253

Page 263: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DetermininghashsettingsWhenyouconductalightweightharvest,youcanmakecertainhash-settingconfigurationchanges.

ProcedureDeterminethehashsettings.Afilehashisaunique,calculatednumberthatisbasedonthecontentofthefile.ByselectingPartialdataobjectcontent,youreducetheprocessingtocreatethehash.However,thetwodifferentdataobjectsmightcreatethesamehash.Itisasmallbutpotentialriskandisonlyrelevantforfull-textharvests.

Parenttopic:Lightweightharvestparametersettings

RelatedconceptsLightweightharvestparametersettings

IBMUnstructuredData751, p. 254

Page 264: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

JobconfigurationJobshavedifferentfunctions,anddependingonthejobtypethatischosen,differentsystemoutcomesoccur.Severaljobsthatarereadyforusearealsoincluded.

Jobsstarttaskssuchasharvests.Theycanberunatthetimeofcreationorscheduledtorunatadesignatedfuturetimeandatregularintervals.Jobsconsistofeitherasinglesteporaseriesofsteps.Theactionsavailableateachstepdependonthetypeofjobthatisbeingcreated.Severaljobsarereadyforuse.Theyaredescribedinthistable.

Table1.Out-of-the-boxjobtypesJob Description

Centeradeletedfilessynchronizer

Anunscheduled,one-stepjobthatsynchronizesthedeletedCenterafiles.ThisjobisintheLibrary/Jobsfolder.

WindowsShare(CIFS)/NFSretentionvolumedeletedfilessynchronizer

Anunscheduled,one-stepjobthatharveststheWindowsShare/NFSretentionvolumes,lookingforfilesthatrequireremovalbecausethephysicalfilewasdeletedfromtheretentionfilesystem.ThisjobisintheLibrary/Jobsfolder.

DatabaseCompactor

Ascheduledjobthathelpstolimit"bloat"(unnecessarystorageusage)inthedatabase.Whilethisjobruns,itmusthaveexclusive,uninterruptedaccesstothedatabase.Administratorscanoverridethisjobbylogginginandthenproceedtousethesystem.ThisjobisintheLibrary/Jobsfolder.

EnterpriseVaultretentionvolumedeletedfilessynchronizer

Anunscheduled,one-stepjobthatharveststheEnterpriseVaultretentionvolumes,lookingforfilesthatrequireremovalbecausethephysicalfilewasdeletedfromtheretentionfilesystem.ThisjobisintheLibrary/Jobsfolder.

Harvesteveryvolume Anunscheduled,one-stepjobthatharvestsallprimaryandretentionvolumes.ThisjobisintheWorkspace/Templates/Jobsfolder.

Hitachideletedfilessynchronizer

Anunscheduled,one-stepjobthatharveststheHitachivolumes,lookingforfilesthatrequireremovalbecausethephysicalfilewasdeletedfromthefilesystem.ThisjobisintheLibrary/Jobsfolder.

IBMInformationArchivedeletedfilessynchronizer

Anunscheduled,one-stepjobthatharveststheIBMInformationArchivevolumes,lookingforfilesthatrequireremovalbecausethephysicalfilethatwasdeletedfromthefilesystem.ThisjobisintheLibrary/Jobsfolder.

Systemmaintenanceandcleanup

AmultistepjobintheLibrary/Jobsfolder.Thesystemisconfiguredtorunasystemmaintenanceandcleanupjobonceadayandincludestheseitems:

EmailusersaboutreportsEmailAdministratorsaboutreportsDeleteoldreportsDeleteoldharvestsLoadindexesOptimizefull-textindexes

UpdateAgeExplorers

Aone-stepjobintheLibrary/Jobsfolderthatrecalculatestheseitems:

OwnerExplorerdataforAccessDateOwnerExplorerdataforModifiedDateCreatedDate(APIonly)values

CreatingajobCreatingajobisthefirststeptoworkwithdifferentjobtypes.CreatingajobtodiscoverretentionvolumesJobscanbecreatedwithvarioustypesofsteps,includinghowtodiscoverCIFSretentionvolumes.

IBMUnstructuredData751, p. 255

Page 265: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

EditingajobExisting,createdjobscanbeedited.StartingajobJobscanbestartedonanas-neededbasis.SavingajobJobscanbesavedonanas-neededbasisforfutureuse.RunningapredefinedjobPredefinedjobscanberunonanas-neededbasis.DeletingajobJobscanbedeletedwhentheyarenolongerneeded.MonitoringprocessingYoucantrackthesystem’sprocessingonyourharvest/policyanddiscoveryexporttaskswiththeViewcachedetailsfeature.Theappliancegathersdatainincrementsandcachesthedataasitgathersit.Ifacollectionisinterrupted,theappliancecanresumecollectionatthepointthatitwasinterrupted,insteadofstartingoverfromthebeginningofthetask.

IBMUnstructuredData751, p. 256

Page 266: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

CreatingajobCreatingajobisthefirststeptoworkwithdifferentjobtypes.

Procedure1. FromtheFolderstab>Workspacefolder,selectNew>Job.2. Enterauniquejobname.3. IntheSavein:list,selecttheappropriatefolder,andthejobiscreated.4. ClickOK.Ifyouwanttoviewthejobandaddsteps,clickYes.5. OntheViewjobpage,clickAddstepandselectasteptypefromthelist.6. ForRunharvestjobs,ontheSpecifyharvestandloadoptionspage,configurethe

followingoptions:Harvestthesevolumes:Selectavolumefromthelist.Harvesttype:Specifythetypeofharvest:

Runafullharvest:Alldataobjectsonthisvolumeareindexed.Runanincrementalharvest(default):Onlyfilesordataobjectsthatchangedsincethelastharvestisindexed.

Harvestandloadscheduling:Youcanseparateharvestandloadprocessestolimitresourceuse.Selectoneoftheoptions:

LoadindexeswhenharvestcompletesLoadindexeswithnextnightlysystemservicesjob:Thisoptiondelaystheindexloadingtorunwiththenextsystem-servicesjobaftertheharvestiscompleted.Thesystem-servicesjobisscheduledtorunatmidnightbydefault.

Runharvestonly:Selectthisoptionifyouplantoloadharvesteddataintoindexeslater.Loadindexesonly:Selectthisoptiontoloadpreviouslyharvesteddataintoindexes.

7. Harvestsampling:Selectthisoptionifyouwanttolimittheharvesttoasmallersample.Thisoptionskipseverysecond,third,10th,orothernumberdataobjectasenteredinthetextbox.

8. Harvestlimits:Limittheharvestbytimeortotalnumberofdataobjects.Enterthenumberofminutesornumberofdataobjects.

9. ClickOK.

Parenttopic:Jobconfiguration

RelatedconceptsJobconfiguration

IBMUnstructuredData751, p. 257

Page 267: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

CreatingajobtodiscoverretentionvolumesJobscanbecreatedwithvarioustypesofsteps,includinghowtodiscoverCIFSretentionvolumes.

Procedure1. FromtheFolderstab>Workspacefolder,selectNew>Job.2. Enterauniquejobname.3. IntheSavein:list,selecttheappropriatefolder,andthejobiscreated.4. ClickOK.Ifyouwanttoviewthejobandaddsteps,clickYes.5. OntheViewjobpage,clickAddstep.6. SelectDiscoverRetentionvolumes.7. IntheDiscoverRetentionvolumelist,selecttheretentionvolumetobeusedforthisjob.8. EnterthedurationthattheharvestrunsinRunharvestfor__,andthenselectMinutesorHours.

9. EnterthenumberofdataobjectstobeharvestedinOnlyharvest__dataobjects.10. ClickOK.

Parenttopic:Jobconfiguration

RelatedconceptsJobconfiguration

IBMUnstructuredData751, p. 258

Page 268: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

EditingajobExisting,createdjobscanbeedited.

Procedure1. FromtheFolderstab>Workspacefolder,clickthejobthatyouwanttoedit.TheJob

detailspageopens.2. ClickEditjobdetails.TheEditjobdetailsdialogboxappears.Youtospecifythetime,

date,andfrequencyforthejobtorun.IntheTime:field,enterthetimethatthejobmuststart,orclickNowtopopulatethetimefieldwiththecurrenttime.Ifyoudidnotspecifyallofthejobsteps,youmightwanttoaddsometime.IntheDate:field,enterthedateonwhichtorunthejob,orclickTodaytopopulatethedatefieldwiththecurrentdate.

3. UsingtheoptionsintheFrequencyfield,specifyhowoftenthejobmustrun.IfyouselectNone,thejobrunsonce,atthetimeanddateprovided.

4. ClickOK.5. Toeditthejobsteps:

a. AddasteptobyjobbyclickingAddstep.b. EditanexistingstepbyclickingEdit.c. RemoveanexistingstepbyclickingRemove.d. ChangetheorderofexistingstepsbyclickingMoveuporMovedownicons.

6. ClickOK.

Parenttopic:Jobconfiguration

RelatedconceptsJobconfiguration

IBMUnstructuredData751, p. 259

Page 269: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

StartingajobJobscanbestartedonanas-neededbasis.

Procedure1. Tostartajob,doeitherofthefollowingactions:

FromtheFolderstab>Workspacefolder,clickthenameofthejobyouwanttostart,andintheJobdetailspage,clickStartjob.FromtheFolderstab>Workspacefolder,right-clickthejobandselectStartjob.

2. IntheSchedulearea,astartedjobisdisplayedasThisjobisrunningnow.3. ClickOKtoreturntotheFolderstab.ThestartedjobdisplaysRunningintheStatus

column.

Parenttopic:Jobconfiguration

RelatedconceptsJobconfiguration

IBMUnstructuredData751, p. 260

Page 270: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

SavingajobJobscanbesavedonanas-neededbasisforfutureuse.

Procedure1. FromtheFolderstab>Workspacefolder,clickthenameofthejobyouwouldliketo

save.TheJobdetailspageopens.2. ClickSaveas,andtheSavejobasdialogboxappears.3. IntheJobnametextbox,verifythatthejob’snameiscorrect.Ifitissavedinthesame

folderasanotherjob,eachjobmusthaveauniquename.4. IntheSaveinlist,selectthefolderinwhichyouwouldliketosavethejob.5. ClickOKtoclosetheSavejobasdialogboxandtoreturntotheFolderstab.

Parenttopic:Jobconfiguration

RelatedconceptsJobconfiguration

IBMUnstructuredData751, p. 261

Page 271: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

RunningapredefinedjobPredefinedjobscanberunonanas-neededbasis.

Procedure1. GotoFolders>Library.2. ClickJobsfoldertoopenthejoblist.3. Clickthepredefinedjobthatyouwanttoedit.4. Tosettheschedule,clickEditjobdetails,completedthechanges,andthenclickOK.5. Alternately,clickStartjob(selectedjobsonly)inthebottomrightareaofthepaneto

startthejobimmediately.

Parenttopic:Jobconfiguration

RelatedconceptsJobconfiguration

IBMUnstructuredData751, p. 262

Page 272: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DeletingajobJobscanbedeletedwhentheyarenolongerneeded.

Procedure1. FromtheFolderstab>Workspacefolder,selectFilterby...Jobs.2. Clickthejobnametoopenthejobdetails.3. ClickDeleteinthelower-lefthandcornerofthescreen.ClickOK.

Parenttopic:Jobconfiguration

RelatedconceptsJobconfiguration

IBMUnstructuredData751, p. 263

Page 273: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

MonitoringprocessingYoucantrackthesystem’sprocessingonyourharvest/policyanddiscoveryexporttaskswiththeViewcachedetailsfeature.Theappliancegathersdatainincrementsandcachesthedataasitgathersit.Ifacollectionisinterrupted,theappliancecanresumecollectionatthepointthatitwasinterrupted,insteadofstartingoverfromthebeginningofthetask.

ProcedureFromAdministration>Dashboard,intheAppliancestatuspane,clickViewcachedetails.TheViewcachedetailspageappears.Toseeharvest/policyprogress,clicktheVolumecachetab.Or,toseediscoveryexportjobprogress,clicktheDiscoveryexportcachetab.Note:Informationforajobisonlyavailablewhilethejobisrunning.Afterataskiscompleted,thejobdisappearsfromthelist.

Table1.Harvest/Volumecachedetails:Fields,descriptions,andvaluesField Description Value

Name Thenameofthevolumethatisbeingharvested.

Startdate Thetimethatthejobstarted.

Type Thetypeofjobthatisrun.CopyHarvest-fullHarvest-incremental

State Thestatusoftheprocess.

Caching:Thevolumecacheisbeingcreated/updatedbyaharvestorpolicyCached:Creationorupdateofvolumecacheiscomplete(harvestonly)Loading:Volumecachecontentsarebeingsuccessfullyloadedintothevolumecluster

Full-text Itindicateswhetherafull-textharvestisbeingconducted. YesorNo

Viewauditlinkdetails

Linktotheharvest/policyauditpage.

Table2.Discoveryexportcachedetails:Fields,descriptions,andvaluesField Description Value

Name Thenameofthevolumethatisbeingprocessed.

Startdate

Thestartingdate/timefortheprocess.

Type Typeoffilethatisbeingpreparedforexport. Discoveryexport

State Thestatusofthediscoveryexportjob.

Aborted:Discoveryexportpolicywascanceledordeletedbytheuser.Caching:Thevolumecacheisbeingcreated/updatedbyaharvestorpolicy.Cached:Creationorupdateofvolumecacheiscomplete(harvestonly).Loading:Volumecachecontentsarebeingsuccessfullyloadedintothevolumecluster.

Full-text

Whetherafull-textharvestisbeingconducted. YesorNo

IBMUnstructuredData751, p. 264

Page 274: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DeletingavolumecacheVolumecachescanbedeletedasneeded.DeterminingwhetheraharvestisstuckThespeedofaharvestdependsonvolumesizeandprocessingspeed;however,harvestsdooccasionallybecomestuckandareunabletocompletesuccessfully.Usetheproceduresthatareoutlinedheretotroubleshoottheharvestprocess.

Parenttopic:Jobconfiguration

RelatedconceptsJobconfiguration

RelatedtasksDeletingavolumecacheDeterminingwhetheraharvestisstuck

IBMUnstructuredData751, p. 265

Page 275: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DeletingavolumecacheVolumecachescanbedeletedasneeded.

Procedure1. Fromthevolumecacheordiscoveryexportcachelist,selectthecheckboxofthecache

youwanttodelete.2. ClickDelete.Aconfirmationdialogappears.ClickOK.

Parenttopic:Monitoringprocessing

RelatedtasksMonitoringprocessing

IBMUnstructuredData751, p. 266

Page 276: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DeterminingwhetheraharvestisstuckThespeedofaharvestdependsonvolumesizeandprocessingspeed;however,harvestsdooccasionallybecomestuckandareunabletocompletesuccessfully.Usetheproceduresthatareoutlinedheretotroubleshoottheharvestprocess.

Procedure1. ClickAdministration>Dashboard>JobsinProgresstoverifythatyourjobcontinuesto

run.2. InJobsinProgress,notetheTotaldataobjectsencounterednumber.3. Wait15minutes,leavingtheharvesttocontinuetorun.4. NotethenewvalueTotaldataobjectsencountered,andthencompareittothatvalue

denotedpreviously.5. GotoQuestion1:Question1:IstheTotaldataobjectencounteredcounterincreasing?

Yes:Ifthenumberofencountereddataobjectscontinuestoincrease,thentheharvestisrunningcorrectly.No:Ifthenumberofencounteredobjectsremainsthesame,thengotoQuestion2:Question2:Istheloadaverageup?

a. Toviewloadaverages,onAppliancestatus>Aboutappliance>Viewdetails>Systemservices,lookattheloadaveragesintheBasicsysteminformationarea.Yes:Iftheloadaveragesnumberisup,theharvestmightbestuck.Calltechnicalsupporttoreportthattheharvestisstuckonfiles.No:Thejobisnotreallyrunning.Itmeansthatthejobmustberestarted.GotoQuestion3:Question3:Didthejobcompleteonthesecondpass?Yes:Ifthejobcompletedsuccessfullyafteritwasrestarted,thentheharvestisnotstuck.No:Thejobdidnotcompletesuccessfully.Calltechnicalsupporttoreportajobthatdoesnotcomplete.

Parenttopic:Monitoringprocessing

RelatedtasksMonitoringprocessing

IBMUnstructuredData751, p. 267

Page 277: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DesktopcollectionWhenyouconfiguredesktopsettings,youareenablingordisablingencryptionwithinIBM®StoredIQPlatform.TheIBMDesktopDataCollector(desktopclientorclient)enablesdesktopsasavolumetypeordatasource,allowingthemtobeusedjustasothertypesofaddeddatasources.TheIBMDesktopDataCollectorisprovidedasastandardMSIfileandisinstalledaccordingtothetypicalmethod(suchasMicrosoftSystemsManagementService(SMS))usedwithinyourorganization.TheIBMDesktopDataCollectorcancollectPSTs,compressedfiles,andotherdataobjectsandcanremoveitselfwhenitsworkiscompleted.

Afterthedesktopclientisinstalledonadesktop,youconnectandregisteritwiththedataserver.Thatdesktopisavailableasadatasourcewithinthelistofprimaryvolumes.Additionally,whilethesnippetsupportandthesnippetstep-upactionaresupportedbyIBMDesktopDataCollector,adesktopcannotbethetargetordestinationofanaction.

IBMDesktopDataCollectorclientinstallationIBMDesktopDataCollectorinstallationmethodsDuringinstallation,thehostnameandIPaddressoftheIBMStoredIQPlatformmustbesupplied.Iftheinstallationisconductedmanuallybyusers,youmustprovidethisinformationtothemusingemail,atextfile,oranothermethod.ConfiguringtheIBMDesktopDataCollectorcollectionDesktopcollectionconfigurationincludestheIBMDesktopDataCollectorinstallerandEncryptedFileSystem.Deletepolicy:specialnotesWhenyouusethedeletepolicy,certainfilescannotbedeleted.

IBMUnstructuredData751, p. 268

Page 278: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

IBMDesktopDataCollectorclientinstallationTheIBM®DesktopDataCollectoragentworkswiththefollowingoperatingsystems:

WindowsXP32-and64-bit,ServicePack2orlaterWindows732-and64-bitWindowsVista32-and64-bitWindowsserver2003,2008

Installationrequiresadministrativeprivilegesonthedesktop.BeforeyouusetheIBMDesktopDataCollector,theyoumightwanttonotifyusersthatdesktopcollectionisgoingtobeconductedandmakethemawareofthefollowingitems:

Thedesktopmustbeconnectedoverthenetworkduringdatacollection.Iftheconnectionisinterrupted,IBMDesktopDataCollectorresumesitsworkfromthepointatwhichitstopped.Usersmightnoticeaslightchangeinperformancespeed,butthattheycancontinueworkingnormally.Desktopcollectiondoesnotinterferewithworkprocesses.Thatcertainactionscanbetakenfromthetrayicon:Right-clickforAbout,Restart,Status,andEmailLogs(whichpackageslogsintosinglefileandstartstheemailclientsothattheusercanmailthemtotheIBMStoredIQPlatformadministrator).

Allcommunicationsareoutboundfromtheclient.Theapplianceneverpushesdataorrequeststothedesktop.TheIBMDesktopDataCollectorpingstheapplianceaboutevery60seconds,andtheLastKnownContacttimestatisticisupdatedapproximatelyevery30minutes.Additionally,theIBMDesktopDataCollectorchecksfortaskassignmentsevery5minutes.

OnecandownloadtheinstallerapplicationfromtheapplicationintheConfigurationtab.Also,theAdministratorcantemporarilydisabletheclientserviceonalldesktopsthatareregisteredtothedataserverfromtheConfigurationtab.

Parenttopic:Desktopcollection

RelatedconceptsDesktopcollection

RelatedtasksConfiguringtheIBMDesktopDataCollectorcollection

IBMUnstructuredData751, p. 269

Page 279: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

IBMDesktopDataCollectorinstallationmethodsDuringinstallation,thehostnameandIPaddressoftheIBM®StoredIQPlatformmustbesupplied.Iftheinstallationisconductedmanuallybyusers,youmustprovidethisinformationtothemusingemail,atextfile,oranothermethod.

TheIBMDesktopDataCollectorcanbeinstalledwiththefollowingmethods.

Massdistributionmethod(SMS)TheapplianceIDispartofthedistributionconfiguration.ThismethodsupportspassinginstallationargumentsasMSIproperties.

RequiredSERVERACTIONNODEADDRESS:IPaddressorhostnamefortheActionnode.Whentheinstallationisnotsilent,theuserispromptedforIPaddressorhostname.Thedefaultisthevalueofthisargument.Thisfieldmustbeenteredaccuratelyormanualcorrectionisrequiredinthedesktopconfigurationfile.

OptionalSERVERACTIONNODEPORT:PortnumberfortheAgentontheActionnode.Defaultsto21000,andcanbeonlychangedwhentheagentconnectsonadifferentportthatisthenmappedto21000.NOTRAYICON:SpecifieswhethertheagentdisplaystheIBMDesktopDataCollectortrayiconwhileitisrunning.Changingthesettingto1forcestheagenttorunsilentlyandnotdisplayatrayicon.SERVERACTIONNODEADDRESS:IPaddressorhostnamefortheActionnode.Whentheinstallationisnotsilent,theuserispromptedforIPaddressorhostname.Thedefaultisthevalueofthisargument.Thisfieldmustbeenteredaccuratelyormanualcorrectionisrequiredinthedesktopconfigfile.Emailinglinks:Sendalinkwithinanemailsuchasfile:\\g:\group\install\Client-install.vbs.Thelinkcanbetoanyexecutablefileformatsuchas.BAT,.VBS,or.MSI.The.BAT/.VBSformatscanbeusedtopassclientargumentstoan.MSI.Theuserwhoclicksthelinkmusthaveadministrativeprivileges.NTLogonScript,inwhicha.BATfileor.VBSscriptstartsmsiexec.Examplesaregivenhere:

/i:Install/x{7E9E08F1-571B-4888-AC08-CEA8A076F5F9}:Uninstalltheagent.Theproductcodemustbepresent./quiet:install/uninstallrunssilently.Whenyouspecifythisoption,SERVERACTIONNODEADDRESSmustbesuppliedasanargument.

SetWshShell=CreateObject("WScript.Shell")

WshShell.Run"%windir%\System32\msiexec.exe/iG:\group\install\desktopclient.msiNOTRAYICON=0SERVERACTIONNODEADDRESS=clust017.test.local/q"SetWshShell=CreateObject("WScript.Shell")

SetWshShell=Nothing

MSI

Batchfile

msiexec/iG:\group\install\desktopclient.msiNOTRAYICON=1 SERVERACTIONNODEADDRESS=clust017.test.local/q

Parenttopic:Desktopcollection

Relatedconcepts

IBMUnstructuredData751, p. 270

Page 280: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Desktopcollection

RelatedtasksConfiguringtheIBMDesktopDataCollectorcollection

IBMUnstructuredData751, p. 271

Page 281: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ConfiguringtheIBMDesktopDataCollectorcollectionDesktopcollectionconfigurationincludestheIBM®DesktopDataCollectorinstallerandEncryptedFileSystem.

BeforeyoubeginForproceduralinformationondownloadingtheIBMDesktopDataCollectorinstaller,seeDownloadingtheIBMDesktopDataCollectorinstallerfromtheapplication.

Procedure1. CompletetheprocedurethatisoutlinedinUsingtheEncryptedFile-SystemRecovery

Agent.2. Restarttheserviceandbegincollection,notingthefollowingpoints:

IfthecomputerisnotpartofadomainanditisrunninganyversionofWindowsearlierthan7.0,thentheusernamemustbetheusername.IfthecomputerisnotpartofadomainandrunningWindows7.0orlater,thentheusernamemustbethenameofthePCandthedomain.

Parenttopic:Desktopcollection

RelatedconceptsDesktopcollectionIBMDesktopDataCollectorclientinstallationIBMDesktopDataCollectorinstallationmethodsDeletepolicy:specialnotes

IBMUnstructuredData751, p. 272

Page 282: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Deletepolicy:specialnotesWhenyouusethedeletepolicy,certainfilescannotbedeleted.

WhenyouusetheIBM®DesktopDataCollectortodeleteIBMDesktopDataCollectorfilesfromadesktop,theyareremovedpermanently.Theyarenottransferredtotheapplianceorbackeduptoanyotherlocation.Youmustcarefullyreviewtheinfosetofaffecteddataobjectsbeforeyoutakeadeleteaction.Yourorganizationcanusecustomapplicationsorotherfilesthatyoumightnotwanttodelete.Inreviewingthereturnedlist,donotallowthefollowingfilestobedeleted.

Anythingunderthisdirectory:c:\WindowsAnythingunderthisdirectory:DocumentsandSettings,withtheseextensions:

c:\DocumentsandSettings\<username>\UserData\andextension*.xml

c:\DocumentsandSettings\<username>\Cookies\andextension*.txt

c:\DocumentsandSettings\<username>\StartMenu\Programs\andextension*.lnk

Executablefiles*.dll*.exe*.ocx

Drivers*.sys*.inf*.pnf

Installers*.msi*.mst

Importantdatafiles*.dat*.ini*.old*.cat

Thesefilenamesdesktop.inintuser.datindex.datntuser.polntuser.dat.log

Parenttopic:Desktopcollection

RelatedconceptsDesktopcollection

RelatedtasksConfiguringtheIBMDesktopDataCollectorcollection

IBMUnstructuredData751, p. 273

Page 283: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

FoldersThissectionprovidesbothconceptualandproceduralinformationaboutfoldersandtheirusage.

TheFolderstabdisplaystwotypesoffolders:LibraryandWorkspace.

Library:TheLibraryfoldercontainstheJobsfolder.Note:Thisfoldercannotberenamed,moved,ordeleted.Workspace:TheWorkspacefolderisacustomfolderthatreflectsyouruseofthesystem.Bydefault,itcontainsafolderentitledTemplates.IfyouareusingthesystemforITpurposes,youmightwanttocreatefoldersforeachlocaleorfunction.Note:Thesefolderscanberenamed,moved,ordeleted,andyoualsohavetheoptionsofsettingfoldersecurity.

CreatingafolderFoldersarecreatedfromtheFolderstab.DeletingafolderWhenyoudeletefolders,youcandeleteonlyemptyfolders.MovingafolderFolderscanbemovedfromonelocationtoanother.RenamingafolderFolderscanberenamedasneeded.CopyingitemstodifferentfoldersItemscanbecopiedfromonefoldertoanother.SavingitemsintodifferentfoldersYoucanrenamejobsandsavethemintootherfolders.FilteringitemswithinthefolderviewItemscanbefilteredwithintheFolderview.

IBMUnstructuredData751, p. 274

Page 284: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

CreatingafolderFoldersarecreatedfromtheFolderstab.

Procedure1. FromtheFolderstab,selectNew>NewFolder.TheCreatenewfolderdialogappears.2. IntheName:field,giveanamethatrepresentsthefolder’spurpose(legalmatter,local,

businessunit,orthelike).3. IntheDescription:field,typeadescriptionforthefolder.4. IntheCreatein:field,usethelisttoselectaplaceforthefolder.Allcustomfoldersmust

beplacedintheWorkspaceoraWorkspacesubdirectory;youcannotaddfolderstotheLibraryfolder.

5. ClickOK.Ifyouwanttoopenthefolder,clickOKinthedialogthatappears.

Parenttopic:Folders

RelatedconceptsFolders

IBMUnstructuredData751, p. 275

Page 285: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DeletingafolderWhenyoudeletefolders,youcandeleteonlyemptyfolders.

Procedure1. FromwithintheFolderstab,Workspacefolder,doeitherofthefollowingactions.

Selectthecheckboxnexttothefolderyouwanttodelete,andintheActionslist,selectDelete.Right-clickonafoldernameandselectDelete.

2. Intheconfirmationboxthatappears,clickOK.

Parenttopic:Folders

RelatedconceptsFolders

IBMUnstructuredData751, p. 276

Page 286: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

MovingafolderFolderscanbemovedfromonelocationtoanother.

Procedure1. FromwithintheFolderstab,Workspacefolder,doeitherofthefollowingactions.

Selectthecheckboxnexttothefolderyouwanttomove,andintheActionslist,selectMove.Right-clickonthefoldernameandselectMove.

2. ClickOK,andintheMoveitemsdialog,selectthenewlocationfromthelist.3. ClickOK.

Parenttopic:Folders

RelatedconceptsFolders

IBMUnstructuredData751, p. 277

Page 287: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

RenamingafolderFolderscanberenamedasneeded.

Procedure1. Right-clickonthefoldernameandselectRename.2. IntheRenamefolderdialog,changetheNameandtheDescription.3. ClickOK.

Parenttopic:Folders

RelatedconceptsFolders

IBMUnstructuredData751, p. 278

Page 288: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

CopyingitemstodifferentfoldersItemscanbecopiedfromonefoldertoanother.

Procedure1. FromwithinFolders>Workspace,right-clicktheitemthatyouwanttocopy,andthen

selectCopy.2. IntheCopydialog,assignanewname(ifappropriate)intheNamefield.Youcannot

reusethesamenameforanitemwithinasinglefolder.3. IntheDescriptionfield,typeadescription.4. IntheSaveinlist,choosethelocationforthecopieditem,andthenclickSave.

Parenttopic:Folders

RelatedconceptsFolders

IBMUnstructuredData751, p. 279

Page 289: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

SavingitemsintodifferentfoldersYoucanrenamejobsandsavethemintootherfolders.

Procedure1. Fromtheitem’seditorpane,clickSaveas.2. IntheSave[item]as...pane,typeanameinthe[Item]name:field.3. IntheDescription:field,typeadescription.4. IntheSavein:field,usethelisttoselectalocationfortheitem.5. ClickSave.

Parenttopic:Folders

RelatedconceptsFolders

IBMUnstructuredData751, p. 280

Page 290: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

FilteringitemswithinthefolderviewItemscanbefilteredwithintheFolderview.

Procedure1. FromwithinFolders,clickFilterby...2. Selectthecomponentthatyouwanttodisplay.

Parenttopic:Folders

RelatedconceptsFolders

IBMUnstructuredData751, p. 281

Page 291: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

AuditsandlogsThefollowingsectiondescribestheauditandlogcategoriesinthesystem,includingdescriptionsofthevariousaudittypesandhowtoviewanddownloaddetails.

HarvestauditsHarvestauditsprovideasummaryoftheharvest,includingstatus,date,duration,averageharvestspeed,andaveragedataobjectsize.Theycanbeviewedintwoways:byvolumenameorbythedateandtimeofthelastharvest.ImportauditsVolume-importauditsprovideinformationaboutthevolumeimport.Thisinformationincludesthenumberofdataobjectsthatareimported,thesystemthatisexportedfrom,thetimeanddateofthevolumeimport,whethertheimportedvolumeoverwroteanexistingvolume,andstatus.ThevolumenamelinkstotheImportdetailspage.EventlogsEventlogscaptureseveryactionthatistakenbythesystemanditsusers.Itdocumentsactionsthatsucceedandfail.PolicyauditsPolicyauditsprovideadetailedhistoryofthepolicy.Itincludestypeofaction,datelastrun,startandenddateswithtimes,averagespeed,totaldataobjects,anddataobjectcounts.Theycanbeviewedbyname,volume,time,andbydiscoveryexport.

IBMUnstructuredData751, p. 282

Page 292: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

HarvestauditsHarvestauditsprovideasummaryoftheharvest,includingstatus,date,duration,averageharvestspeed,andaveragedataobjectsize.Theycanbeviewedintwoways:byvolumenameorbythedateandtimeofthelastharvest.

Dataobjectscanbeskippedduringaharvestforvariousreasonssuchastheunavailableobjectoraselecteduseroptionthatexcludesthedataobjectfromtheharvest.TheHarvestdetailspagelistsallskippeddataobjectsthatarebasedonfilesystemmetadatalevelandcontentlevel.

Allskippedharvest-auditdataandotherfilesthatarenotprocessedcanbedownloadedforanalysis.

Table1.Harvestauditbyvolume:FieldsanddescriptionsHarvestauditbyvolumefield Description

Server Theservername.Volume Thevolumename.

Harvesttype Thetypeofharvestthatisconducted:FullHarvest,ACLonly,orIncremental.

Lastharvested Thedateandtimeofthelastharvest.Totalsystemdataobjects Thetotalnumberofsystemdataobjectsencountered.

Dataobjectsfullyprocessed Thenumberofdataobjectsthatwerefullyprocessed.

Dataobjectspreviouslyprocessed Thenumberofdataobjectsthatwerepreviouslyprocessed.

Processingexceptions Thenumberofexceptionsthatareproducedduringprocessing.Binaryprocessed Thenumberofprocessedbinaryfiles.Harvestduration Thelengthoftimeoftheharvest’sduration.Status Theharvest’sstatus:CompleteorIncomplete.

Averageharvestspeed Theaverageharvestspeed,whichisgivenintermsofdataobjectsthatareprocessedpersecond.

Averagedataobjectsize Theaveragesizeofencountereddataobjects.

Table2.Harvestauditbytime:FieldsanddescriptionsHarvestauditby

timefield Description

Harveststart Thetimeanddateatwhichtheharvestwasstarted.

Harvesttype Thetypeofharvestthatisconducted:FullHarvest,ACLonly,orIncremental.

Totalsystemdataobjects Thetotalnumberofsystemdataobjectsthatwerefound.

Dataobjectsfullyprocessed Thetotalnumberofsystemdataobjectsthatwerefullyprocessed.

Dataobjectspreviouslyprocessed

Thetotalnumberofsystemdataobjectsthatwerepreviouslyprocessed.

Processingexceptions Thetotalnumberofencounteredprocessingexceptions.Binaryprocessed Thetotalnumberofprocessedbinaryfiles.Harvestduration Thelengthoftimeoftheharvest’sduration.Status Theharvest’sstatus:CompleteorIncomplete.

Averageharvestspeed Theaverageharvestspeed,whichisgivenintermsofdataobjectsthatareprocessedpersecond.

IBMUnstructuredData751, p. 283

Page 293: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Averagedataobjectsize Theaveragesizeofencountereddataobjects.

Table3.Harvestoverviewsummaryoptions:FieldsanddescriptionsHarvestoverviewsummaryoptions

fieldDescription

Harvesttype Thetypeofharvest:FullHarvest,ACLonly,orIncremental.Harveststatus Theharvest'sstatus.OptionsareCompleteorIncomplete.Harvestdate Thedateandtimeoftheharvest.Harvestduration Thisdurationisthelengthoftimeoftheharvest'sduration.

Averageharvestspeed Theaverageharvestspeed,whichisgivenintermsofdataobjectsthatareprocessedpersecond.

Averagedataobjectsize Theaveragesizeofencountereddataobjects.

Table4.Harvestoverviewresultsoptions:FieldsanddescriptionsHarvestoverview

resultsoptionsfield Description

Totalsystemdataobjects Thetotalnumberofsystemdataobjectsthatwerefound.

Totalcontaineddataobjects Thetotalnumberofcontaineddataobjects.

Totaldataobjects Thetotalnumberofencountereddataobjects.Table5.Harvestoverviewdetailedresults:Fieldsanddescriptions

Harvestoverviewdetailedresultsfield Description

Skipped-previouslyprocessed Thenumberofskippedobjectsthatwerepreviouslyprocessed.

Fullyprocessed Thenumberoffullyprocesseddataobjects.Skipped-cannotaccessdataobject

Thenumberofdataobjectsthatwereskippedastheymightnotbeaccessed.

Skipped-userconfiguration

Thenumberofdataobjectsthatwereskippedbecauseoftheiruserconfiguration.

Skippeddirectories Thenumberofdataobjectsinskippeddirectories.Contentskipped-userconfiguration

Thenumberofdataobjectswherethecontentwasskippedduetouserconfiguration.

Contenttypeknown,partialprocessingcomplete

Thenumberofdataobjectsforwhichthecontenttypeisknownandpartialprocessingiscomplete.

Contenttypeknown,buterrorprocessingcontent

Thenumberofdataobjectsforwhichthecontenttypeisknown,butanerrorwasproducedwhileprocessingcontent.

Contenttypeknown,butcannotextractcontent

Thenumberofdataobjectsforwhichthecontenttypeisknown,butthecontentmightnotbeextracted.

Contenttypeunknown,notprocessed

Thenumberofdataobjectsforwhichthecontenttypeisunknownandisnotprocessed.

Binarytextextracted,fullprocessingcomplete

Thenumberofdataobjectsforwhichthebinarytextisextractedandfullprocessingiscompleted.

Binarytextextracted,partialprocessingcomplete

Thenumberofdataobjectsforwhichthebinarytextisextractedand

partialprocessingiscompleted.

Errorprocessingbinarycontent

Thenumberofdataobjectsforwhichanerrorwasproducedwhilebinarycontentisprocessed.

Total Thetotalnumberofdataobjects.IBMUnstructuredData751, p. 284

Page 294: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Total Thetotalnumberofdataobjects.

ViewingharvestauditsHarvestauditscanbeviewedfromtheAudittab.DownloadingharvestlistdetailsHarvestlistdetailscanbedownloadedina.CSVformat.

Parenttopic:Auditsandlogs

RelatedconceptsAuditsandlogs

RelatedtasksViewingharvestauditsDownloadingharvestlistdetails

IBMUnstructuredData751, p. 285

Page 295: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ViewingharvestauditsHarvestauditscanbeviewedfromtheAudittab.

Procedure1. GotoAudit>Harvests>Viewallharvests.TheHarvestauditbyvolumepageopens,

whichlistsrecentharvestsandincludesdetailsaboutthem.2. IntheVolumecolumn,clickthevolumenamelinktoseetheharvestauditbytimepage

forthatparticularvolume.Theharvestauditbytimepagelistsallrecentharvestsforthechosenvolumeandincludesdetailsabouteachharvest.

3. IntheHarveststartcolumn,clicktheharveststarttimelinktoseetheharvestoverviewpageforthevolume.YoucanalsoaccessthepagebyclickingtheLastharvestedtimelinkontheHarvestauditbyvolumepage.TheHarvestoverviewpageprovidesthefollowingoptions.

Summary:Harvesttype,status,dateandtime,duration,averageharvestspeed,andaveragedataobjectsize.Results:Totalsystemdataobjects,totalcontaineddataobjects,totaldataobjects.Detailedresults:Skipped-previouslyprocessed;fullyprocessed;skipped-cannotaccessdataobject;skipped-userconfiguration;skippeddirectories;contentskipped-userconfiguration;contenttypeknown,partialprocessingcomplete;contenttypeknown,buterrorprocessingcontent;contenttypeknown,butcannotextractcontent;contenttypeunknown,notprocessed;binarytextextracted,fullprocessingcomplete;binarytextextracted,partialprocessingcomplete;errorprocessingbinarycontent;error-gatheringACLs;andtotal.

4. Toviewdetailsondataobjects,clickthelinknexttothedataobjectsunderDetailedresults.

Withtheexceptionsofskipped-previouslyprocessed,fullyprocessed,andthetotal,allotherresultswithmorethanzeroresultshavelinksthatyoucanviewanddownloadresults.Theskippeddataobjectlistincludesobjectname,path,andreasonskipped.Dataobjectscanbeskippedatthefilesystemmetadataleveloratthecontentlevel.Dataobjectsskippedatthecontentlevelarebasedonattributesthatareassociatedwiththedataobjectoritscontents.SkippedDataObjectsResultsDetailsprovidesdetailsaboutskippeddataobjects.

Ifdataobjectswerenotharvested,youmightwanttodownloadthedataobject'sharvestauditlistdetailsforfurtheranalysis.

Parenttopic:Harvestaudits

RelatedconceptsAuditsandlogs

RelatedreferenceHarvestaudits

IBMUnstructuredData751, p. 286

Page 296: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DownloadingharvestlistdetailsHarvestlistdetailscanbedownloadedina.CSVformat.

Procedure1. FromtheHarvestdetailspage,clicktheactivelinknexttothedataobjectsunder

Detailedresults.Apagenamedforthedetailedresultchosen(suchasSkipped-userconfigurationorbinarytextextracted,fullprocessingcomplete)appears.

2. ClicktheDownloadlistinCSVformatlinkontheupperleftsideofthepage.Adialoginformsyouthattheresultsarebeingpreparedfordownload.

3. ClickOK.Anewdialogappears,promptingyoutosavetheopenorsavethe.CSVfile.InformationinthedownloadedCSVfileincludes:

ObjectnameSystempathContainerpathMessageexplainingwhydataobjectwasskippedServernameVolumename

Parenttopic:Harvestaudits

RelatedconceptsAuditsandlogs

RelatedreferenceHarvestaudits

IBMUnstructuredData751, p. 287

Page 297: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ImportauditsVolume-importauditsprovideinformationaboutthevolumeimport.Thisinformationincludesthenumberofdataobjectsthatareimported,thesystemthatisexportedfrom,thetimeanddateofthevolumeimport,whethertheimportedvolumeoverwroteanexistingvolume,andstatus.ThevolumenamelinkstotheImportdetailspage.

Table1.Importsbyvolumesdetails:FieldsanddescriptionsImportsby

volumesdetailsfield

Description

Volume Thenameoftheimportedvolume.Exportedfrom Thesourceserveroftheimportedvolume.Importdate Thedateandtimeonwhichtheimportoccurred.Totaldataobjectsimported Thetotalnumberofimporteddataobjects.

Overwriteexisting Iftheimportoverwroteanexistingvolume,thestatusisYes.Iftheimportdidnotoverwriteanexistingvolume,thestatusisNo.

Status Thestatusoftheimport:CompleteorIncomplete.

ViewingvolumeimportauditdetailsAuditdetailsofvolumeimportscanbeviewed.

Parenttopic:Auditsandlogs

RelatedconceptsAuditsandlogs

RelatedtasksViewingvolumeimportauditdetails

IBMUnstructuredData751, p. 288

Page 298: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ViewingvolumeimportauditdetailsAuditdetailsofvolumeimportscanbeviewed.

Procedure1. GotoAudit>Imports,andclickViewallimports.TheImportsbyvolumepageopens,

whichlistsvolumeimportsandimportinformation.2. ClickavolumenamelinkintheVolumecolumntoviewtheauditdetailsforthat

particularimport.

Parenttopic:Importaudits

RelatedconceptsAuditsandlogs

RelatedreferenceImportaudits

IBMUnstructuredData751, p. 289

Page 299: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

EventlogsEventlogscaptureseveryactionthatistakenbythesystemanditsusers.Itdocumentsactionsthatsucceedandfail.

Theseactionsincludecreatingdraftandpublishedqueriesandtags,runningpolicies,publishingqueries,deletingobjects,configuringsettings,andanyotheractionthatistakenthroughtheinterface.Adetailedoflistoflogentriesisprovidedintheeventlogmessages.

Youcanvieweventlogsforthecurrentdayorreviewsavedlogsfrompreviousdays,andupto30daysworthoflogscanbeviewedthroughtheinterface.Ifyouselectandclearadayoflogs,thoselogsareremovedfromthesystem.

ViewingeventlogsEventlogscanbeviewedfromtheDashboardorfromtheAudittab.SubscribingtoaneventYoucansubscribetoandbenotifiedofdailyeventlogs.ClearingthecurrenteventlogAneventlogcanbeclearedfromtheDashboard.DownloadinganeventlogEventlogscanbedownloadedandsaved.

Parenttopic:Auditsandlogs

RelatedconceptsAuditsandlogs

RelatedtasksViewingeventlogsSubscribingtoaneventClearingthecurrenteventlogDownloadinganeventlog

IBMUnstructuredData751, p. 290

Page 300: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ViewingeventlogsEventlogscanbeviewedfromtheDashboardorfromtheAudittab.

Procedure1. Conducteitherofthefollowingactions:

a. ClickAdministration>Dashboard,andthenlocatetheEventlogsectiononthedashboard.Thecurrentday’slogdisplaystherebydefault.

b. ClicktheAudittabandlocatetheEventlogssection.2. Toviewapreviousday'slogonthedashboard,usetheViewalleventlogslisttoselect

thedayforwhichyouwanttoviewaneventlog.3. Selectadifferentdayfromthevieweventlogfromthelist.Thismenudisplaystheevent

logdatesforthepast30days.EachlogislistedbydateinYYYY-MM-DDformat.

Parenttopic:Eventlogs

RelatedconceptsAuditsandlogsEventlogs

IBMUnstructuredData751, p. 291

Page 301: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

SubscribingtoaneventYoucansubscribetoandbenotifiedofdailyeventlogs.

Procedure1. GotoAudit>Eventlogs.2. ClickViewalleventlogs,andtheEventlogfortodaypageopens.3. Totherightoftheeventlogtowhichyouwanttosubscribe,clickSubscribe.TheEdit

notificationpageappears.4. InDestination,selectthemethodbywhichyouwanttobenotifiedofthiseventlog.If

youselectEmailaddress,becertaintousecommastoseparatemultipleemailaddresses.5. ClickOK.

Note:YoucanalsosubscribetoaneventontheDashboard.IntheEventlogarea,clickSubscribetotherightoftheevent.

Parenttopic:Eventlogs

RelatedconceptsAuditsandlogsEventlogs

IBMUnstructuredData751, p. 292

Page 302: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ClearingthecurrenteventlogAneventlogcanbeclearedfromtheDashboard.

ProcedureOntheAdministration>Dashboard,clickClearforthecurrentview.

Parenttopic:Eventlogs

RelatedconceptsAuditsandlogsEventlogs

IBMUnstructuredData751, p. 293

Page 303: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DownloadinganeventlogEventlogscanbedownloadedandsaved.

Procedure1. Whenyouviewaneventlog,clicktheDownloadlinkforsavingthedatatoatextfile.2. Selecttosavethefilefromtheprompt.Enteranameandselectalocationtosavethe

file.

Parenttopic:Eventlogs

RelatedconceptsAuditsandlogsEventlogs

IBMUnstructuredData751, p. 294

Page 304: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

PolicyauditsPolicyauditsprovideadetailedhistoryofthepolicy.Itincludestypeofaction,datelastrun,startandenddateswithtimes,averagespeed,totaldataobjects,anddataobjectcounts.Theycanbeviewedbyname,volume,time,andbydiscoveryexport.

PolicyauditbynameTable1.Policyauditbyname:Fieldsanddescriptions

Policyauditbynamefield Description

Policyname Thepolicyname.Policystatus Thepolicy'sstatus.Numberoftimesexecuted Thenumberoftimesthatthepolicywasrun.

Mostrecentdateexecuted Thedateonwhichthepolicywaslastrun.

PolicyauditbyvolumeTable2.Policyauditbyvolume:Fieldsanddescriptions

Policyauditbyvolumefield Description

Volume Thenameofthevolumeonwhichthepolicywasrun.Mostrecentdateapolicywasexecuted Themostrecentdateonwhichthepolicywaslastrun.

Numberofpoliciesexecuted Thenumberofpoliciesthatwererun.

PolicyauditbytimeTable3.Policyauditbytime:Fieldsanddescriptions

Policyauditbytimefield Description

Policyname Thepolicyname.Policystatus Thestatusofthepolicy:CompleteorIncomplete.Start Thetimeatwhichthepolicy'sexecutionwasstarted.End Thetimeatwhichthepolicy'sexecutionwascomplete.Successcount Thenumberofprocessedmessagesthatareclassifiedasasuccess.Failurecount Thenumberofprocessedmessagesthatareclassifiedasafailure.Warningcount Thenumberofprocessedmessagesthatareclassifiedasawarning.Othercount Thenumberofprocessedmessagesthatareclassifiedasother.

Totaldataobjects Thetotalnumberofdataobjects.Actiontype Thetypeofpolicythattookplace.Ag.actions/second Theaveragenumberofactionspersecond.

PolicyauditbydiscoveryexportTable4.Policyauditbydiscoveryexports:Fieldsanddescriptions

Policyauditbydiscoveryexport Description

IBMUnstructuredData751, p. 295

Page 305: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

discoveryexportfield

Description

Discoveryexportname Thenameofthediscoveryexport.

Numberruns Thenumberoftimesthepolicyran.Mostrecentexportstatus Thestatusofthemostrecentdiscoveryexport.

Mostrecentloadfilestatus Thestatusofthemostrecentloadfile.

Mostrecentdateexecuted Thedateofthemostrecentpolicyexecution.

DiscoveryexportrunsbydiscoveryexportTable5.Discoveryexportrunsbydiscoveryexport:Fieldsanddescriptions

Discoveryexportrunsbydiscovery

exportfieldDescription

Discoveryexportrun Thenameofthediscoveryexportrun.Numberofexecutions Thenumberoftimestherunwasstarted.Successcount Thenumberofprocessedmessagesthatareclassifiedasasuccess.Failurecount Thenumberofprocessedmessagesthatareclassifiedasafailure.Warningcount Thenumberofprocessedmessagesthatareclassifiedasawarning.Othercount Thenumberofprocessedmessagesthatareclassifiedasother.Totaldataobjects Thetotalnumberofdataobjects.Exportstatus Thestatusoftheexport:CompleteorIncomplete.Loadfilestatus Thestatusoftheloadfile:CompleteorIncomplete.Note:Awarninginapolicyaudittrailisasuccesswiththefollowingconditions:

IfyoucopyanExchangeitemsuchasre:,thereiscopied,notthe:.Itgeneratesawarning.Thecopiedfileisrenamed.Thefilesystemtowhichyouarecopyingdoesnotacceptcharactersinthefilename.

ViewingpolicyauditdetailsPolicyauditscanbeviewedbyname,volume,time,ordiscoveryexport.SearchauditfeatureWiththesearchauditfeature,youcansearchaudittrailsbyenteringeitherbyPolicyDetails,ExecutionDetails,orDataObjectDetails.SavingresultsfromanauditYoucansavetheresultsofpolicyexecutionsintoPDFandXMLfiles.TheinformationcanbesavedasPDFandXMLfiles.Theexportingofinformationappearsasarunningjobonthedashboarduntilcompleted.PolicyauditmessagesApolicyauditshowsthenumberofdataobjectsthatwereprocessedduringthepolicyexecution.Processeddataobjectsaredividedintothesecategories:Success,Warnings,Failures,andOther(discoveryexportpoliciesonly).

Parenttopic:Auditsandlogs

RelatedconceptsAuditsandlogsSearchauditfeature

Relatedtasks

IBMUnstructuredData751, p. 296

Page 306: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ViewingpolicyauditdetailsViewingapolicyauditbynameViewingapolicyauditbyvolumeViewingapolicyauditbytimeViewingapolicyauditbydiscoveryexportSavingresultsfromanaudit

IBMUnstructuredData751, p. 297

Page 307: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ViewingpolicyauditdetailsPolicyauditscanbeviewedbyname,volume,time,ordiscoveryexport.

Procedure1. GotoAudit>Policies,andthenclickName.ThePolicyauditbynamepageprovides

policynameandstatus,thenumberoftimesitwasrun,andthetimeanddateofthemostrecentexecution.

2. ClickapolicynametoopenthePolicyexecutionsbytimepage.3. ClickapolicynametoopenthePolicyexecutionresultspage.

Note:Toviewthelistofdataobjects,clickthe[#]dataobjectslink.Tocreateareport,clickCreateXMLorCreatePDF.a. ClickVolumetoopenthepolicyauditbyvolumepage.b. ClickavolumelinktogotothePolicyauditbytimepage.c. ClickTimetoseeAuditbytimepageforthepolicy.d. OnthePolicyauditbytimepage,clickthepolicynametoopenthePolicyexecution

resultspage.Toviewthelistofdataobjects,clickthe[#]dataobjectslink.Tocreateareport,clickCreateXMLorCreatePDF.

e. ClickDiscoveryexport.f. OnthePolicyauditbydiscoveryexportpage,clickthediscoveryexportnameto

opentheDiscoveryexportrunsbyproductionpage.Thepagedetailsfurtherinformationaccordingtotheincrementalrunsofthepolicy.

g. ClickapolicynametoopenthePolicyexecutionsbytimepage.h. ClickapolicynametoopenthePolicyexecutionresultspage.Toviewthelistof

dataobjects,clickthe[#]dataobjectslink.Tocreateareport,clickCreateXMLorCreatePDF.

Asyoureviewauditresultsthroughthepages,youcancontinueclickingthroughtoreviewvariouslevelsofinformation,fromthevolumeandpolicyexecutionleveldowntothedataobjects.Toviewmorepolicyexecutiondetails,clickthepolicynameintheexecutionsummarypage,whichcanbeaccessedbyanyofthepolicyviews.Asyoucontinuebrowsing,IBM®StoredIQPlatformprovidesmoredetailedinformationsuchas:

SourceanddestinationsettingsPolicyoptions:Detailsofthepolicyaction.Thissectionreflectstheoptionsthatareselectedwhenyoucreatethepolicy.Mostattributesthatappeardependuponthetypeofpolicyrunandtheoptionsavailableinthepolicyeditor.Query(eitherIBMStoredIQPlatformoruser-defined)Viewmetadatalink:Theviewmetadatapagedescribessecuritydetailsforsourceanddestinationlocationsofthepolicyaction.

ViewingapolicyauditbynamePolicyauditscanbeviewedbytheirname.ViewingapolicyauditbyvolumePolicyauditscanbeviewedbyvolume.ViewingapolicyauditbytimePolicyauditscanbeviewedbytime.ViewingapolicyauditbydiscoveryexportPolicyauditscanbeviewedbydiscoveryexport.

Parenttopic:Policyaudits

RelatedconceptsAuditsandlogs

RelatedreferencePolicyaudits

IBMUnstructuredData751, p. 298

Page 308: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

IBMUnstructuredData751, p. 299

Page 309: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ViewingapolicyauditbynamePolicyauditscanbeviewedbytheirname.

Procedure1. GotoAudit>Policies.2. ClickName.ThePolicyauditbynamepageprovidespolicynameandstatus,thenumber

oftimesitisrun,andthetimeanddateofthemostrecentexecution.3. ClickapolicynametoopenthePolicyexecutionbytimepage.

Parenttopic:Viewingpolicyauditdetails

RelatedconceptsAuditsandlogs

RelatedreferencePolicyaudits

IBMUnstructuredData751, p. 300

Page 310: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ViewingapolicyauditbyvolumePolicyauditscanbeviewedbyvolume.

Procedure1. GotoAudit>Policies.2. ClickVolume.ThePolicyauditbypageprovidespolicyname,itsmostrecenttime,date

ofexecution,andthenumberofpoliciesthatwererun.3. ClickapolicynametoopenthePolicyexecutionsbytimepage.4. ClickthepolicynametoopenthePolicyexecutionsbyresultspage.

Parenttopic:Viewingpolicyauditdetails

RelatedconceptsAuditsandlogs

RelatedreferencePolicyaudits

IBMUnstructuredData751, p. 301

Page 311: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ViewingapolicyauditbytimePolicyauditscanbeviewedbytime.

Procedure1. GotoAudit>Policies.2. ClickTime.Thepolicyauditbytimeprovidesinformationaboutthepolicy.3. OnthePolicyauditbytimepage,clickthepolicynametoopenthePolicyexecution

resultspage.

Parenttopic:Viewingpolicyauditdetails

RelatedconceptsAuditsandlogs

RelatedreferencePolicyaudits

IBMUnstructuredData751, p. 302

Page 312: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ViewingapolicyauditbydiscoveryexportPolicyauditscanbeviewedbydiscoveryexport.

Procedure1. ClickDiscoveryexport.2. OnthePolicyauditbydiscoveryexportpage,clickthediscoveryexportnametoopenthe

Discoveryexportrunsbyproductionpage.Thepagedetailsfurtherinformationaccordingtotheincrementalrunsofthepolicy.

3. ClickapolicynametoopenthePolicyexecutionsbytimepage.4. ClickapolicynametoopenthePolicyexecutionresultspage.

Parenttopic:Viewingpolicyauditdetails

RelatedconceptsAuditsandlogs

RelatedreferencePolicyaudits

IBMUnstructuredData751, p. 303

Page 313: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

SearchauditfeatureWiththesearchauditfeature,youcansearchaudittrailsbyenteringeitherbyPolicyDetails,ExecutionDetails,orDataObjectDetails.

PolicydetailsPolicyauditscanbesearchedwithanyofthesedetails.

Table1.Policyauditdetails:FieldsanddescriptionsPolicydetail

field Description

Auditsearchbypolicydetails

Inthisarea,selectsearchcriteria,definetheirvalues,andthenaddthemtothelisttosearchacrossallaudits.

Specifysearchcriteria Inthisarea,specifythePolicyname,thePolicystate,andtheActiontype.

Auditsearchcriteria

IntheFindauditsthatmatchlist,selecteitherAnyofthefollowingorAllofthefollowing.

ExecutiondetailsPolicyauditscanbesearchedwithanyoftheseexecutiondetails.

Table2.Policyauditexecutiondetails:FieldsanddescriptionsExecutiondetail

field Description

Auditsearchbyexecutiondetail

Inthisarea,selectsearchcriteria,definetheirvalues,andthenaddthemtothelisttosearchacrossallaudits.

Specifysearchcriteria

Inthisarea,specifytheActiontype,Actionstatus,Actionstartdate,Actionenddate,Totalcount,Successcount,Failurecount,Warningcount,Sourcevolume,Destinationvolume,orQueryname.

Auditsearchcriteria

IntheFindauditsthatmatchlist,selecteitherAnyofthefollowingorAllofthefollowing.

DataobjectdetailsPolicyauditscanbesearchedwithanyofthesedata-objectdetails.

Table3.Policyauditdataobjectdetails:FieldsanddescriptionsDataobjectdetailsfield Description

Auditsearchbydataobjectdetails

Inthisarea,selectsearchcriteria,definetheirvalues,andthenaddthemtothelisttosearchacrossallaudits.

Specifysearchcriteria

Inthisarea,specifytheSourcevolume,Destinationvolume,Sourceobjectname,Destinationobjectname,Sourcesystempath,Destinationsystempath,orActionresult.

Auditsearchcriteria

IntheFindauditsthatmatchlist,selecteitherAnyofthefollowingorAllofthefollowing.

Parenttopic:Policyaudits

RelatedreferencePolicyaudits

IBMUnstructuredData751, p. 304

Page 314: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

SavingresultsfromanauditYoucansavetheresultsofpolicyexecutionsintoPDFandXMLfiles.TheinformationcanbesavedasPDFandXMLfiles.Theexportingofinformationappearsasarunningjobonthedashboarduntilcompleted.

Procedure1. GotoAudit>Policies.2. IntheBrowsebyoptions,clickTime.3. Clickthepolicyname.4. IntheResultspane,clickDataobjectstoseeitemsthatwereresponsivetothepolicy.To

downloadthematerialin.CSV,clickCSV.5. OnthePolicyexecutionresultspage,selectCreatePDFtogenerateaPDForCreate

XMLtogenerateanXMLfileoftheresults.6. Accessthereportthroughtheinboxonthenavigationpage.

Parenttopic:Policyaudits

RelatedconceptsAuditsandlogs

RelatedreferencePolicyauditsPolicyauditmessages

IBMUnstructuredData751, p. 305

Page 315: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

PolicyauditmessagesApolicyauditshowsthenumberofdataobjectsthatwereprocessedduringthepolicyexecution.Processeddataobjectsaredividedintothesecategories:Success,Warnings,Failures,andOther(discoveryexportpoliciesonly).

Table1.TypesofandreasonsforpolicyauditmessagesAudit

messagetype Reason

Success

Dataobjectisaduplicateof[objectname]Dataobjectskippedbutisloadedinloadfile.Itappliestointermediateandfilesarchivesproducedduringadiscoveryexportpolicy.Dataobjectisaduplicateproducedinapreviousrun(discoveryexportonly).

Warning

SetdirectoryattributesResettimestampsSetattributesSettimestampsSetsecuritydescriptor(WindowsShare)Setaccessmodes(WindowsShare)SetownerinformationSetgroupinformation(NFS)SetsecuritypermissionsCreatealinkaftermigration(WindowsShare,NFS)Findtemplatetocreateashortcut(WindowsShare)Extracttextfortheobject(Discoveryexportpolicy)

Failure

FailedtocreatetargetdirectorystructureSourcedoesnotexistFailedtofindanewnamefortheincomingobjectTargetisadirectoryFilecopyfailedCannotcreatetargetErrorcopyingdatatotargetCannotcopyduetonetworkerrorsCannotdeletesourceaftermoveTargetdiskisfullSourceequalstargetonacopyormoveInsufficientpermissionsingeneraltoconductanactionAllmodifyactionsfailedFiletimedoutwaitinginthepipelineFileunderretention;cannotbedeleted(retentionserver)Dataobjectisaconstituentofacontainerthatalreadyencounteredfailure(discoveryexportpolicy)

Other

Dataobjectsarecategorizedintheothercategoryduringadiscoveryexportpolicywhen:

Adataobjectisamemberthatmakesitscontainerresponsive.Adataobjectisanon-responsivememberofacontainer.

Parenttopic:Policyaudits

IBMUnstructuredData751, p. 306

Page 316: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

RelatedconceptsAuditsandlogs

RelatedtasksSavingresultsfromanaudit

IBMUnstructuredData751, p. 307

Page 317: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DeployingcustomizedwebservicesThisprocedurehighlightsthebasicstepsthatarerequiredtodeploySharePointcustomwebservices.

AboutthistaskItappliesonlytoSharePoint2013webservices.

Procedure1. Obtaintheinstallationpackage.ThispackageiscreatedforyoubyIBM®.2. Uninstallanexistinginstanceofthewebservice.3. Installtheinstallationpackage.4. Verifythatthewebserviceishosted.5. Configureadminknobs.

UninstallinganexistinginstanceofthewebserviceToinstallanupgradetoawebservice,anyprevious,existinginstancemustfirstbeuninstalled.VerifyingthelocationofthehostedwebserviceThisproceduredetailshowtoverifythelocationofthehostedwebserviceandaccessitinabrowser.ConfigurationofadministrationknobsIBMStoredIQhasvariousadministrationknobsthatcanbecustomizedtodeploywebservices.Thissectionlistsanddescribesthevariousknobsandprovidesusagenotesandexamples.

IBMUnstructuredData751, p. 308

Page 318: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

UninstallinganexistinginstanceofthewebserviceToinstallanupgradetoawebservice,anyprevious,existinginstancemustfirstbeuninstalled.

AboutthistaskAllstepswithinthisprocedurearecompletedontheSharePointserver.

Procedure1. WithinIIS,clickSitesandfindthewebsitethatwascreatedbythepreviousinstallation.

Right-clickthatwebsiteandremoveit.2. WithinIIS,clickApplicationPools,findthewebapplicationthatwascreated(ithasthe

samenameasthewebsite).Right-clickthatwebapplicationandremoveit.3. InWindowsExplorer,gotothefolderwherethewebservicewasdeployedanddeleteall

contentwithinthisfolder.4. ResetIISwiththeiisresetcommand.

Parenttopic:Deployingcustomizedwebservices

RelatedtasksDeployingcustomizedwebservices

IBMUnstructuredData751, p. 309

Page 319: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

VerifyingthelocationofthehostedwebserviceThisproceduredetailshowtoverifythelocationofthehostedwebserviceandaccessitinabrowser.

Procedure1. WithinIISManager,clickSites,andverifythatyouseethenewsitenamethatislisted

alongwiththenamethatisenteredintotheinstaller.2. ExpandSitesandverifythatyoucanseethenewsitenamethatislistedalongwiththe

namethatisenteredintotheinstaller.3. SelectthenewlycreatedsiteandswitchtotheContentView,whichisontherightpane.4. AnSVCfilecorrespondstotheinstalledwebservicethatisinstalled.Right-clicktheSVC

fileandclickBrowse.ThewebserviceURLisstartedinabrowser,theaddressbarofwhichcontainstheHTTPlocationofthewebservicesuchashttp://localhost:9000/UpdateItemService.svc.

Parenttopic:Deployingcustomizedwebservices

RelatedtasksDeployingcustomizedwebservices

IBMUnstructuredData751, p. 310

Page 320: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Configurationofadministrationknobs

IBM®StoredIQhasvariousadministrationknobsthatcanbecustomizedtodeploywebservices.Thissectionlistsanddescribesthevariousknobsandprovidesusagenotesandexamples.

Table1.IBMStoredIQadministrationknobs

Adminknob Defaultvalue Notes Example

sharepoint_

custom_

webservice

_location

Locationofcustomweb-serviceusedtofacilitatemigrationoftimestampsandownerinformation.

INSERTINTOadminknobs(name,value,description,valuetype,use)SELECT'sharepoint_custom_webservice_loca-tion','','Locationforcustomweb-servicehostedonSharePoint,eg:9100:/UpdateItemService.svc','str',2WHERE(SELECTnameFROMadminknobsWHEREname='sharepoint_custom_webservice_loca-tion')ISNULL;

sharepoint_

harvest_docs_

only

Thedefaultvalueiszero(0).

Whensetto1,IBMStoredIQwillharvestonlydocumentlibrariesfromSharePoint.

INSERTINTOadminknobs(name,value,description,valuetype,use)SELECT'sharepoint_harvest_docs_only',0,'HarvestonlySharepointdocumenttypelistobjects','int',1WHERE(SELECTnameFROMadminknobsWHEREname='sharepoint_harvest_docs_only')ISNULL;

global_copy_

ignore_target

_vc

Thedefaultvalueiszero(0).

Whensetto1,IBMStoredIQwillnotautomaticallyharvestthedestinationvolumewhenperformingcopies.

INSERTINTOadminknobs(name,value,description,valuetype,use)SELECT'global_copy_ignore_target_vc',0,'Globaloverridetoturnoffauto-harvestsonacopy','int',1WHERE(SELECTnameFROMadminknobsWHEREname='global_copy_ignore_target_vc')ISNULL;

Parenttopic:Deployingcustomizedwebservices

RelatedtasksDeployingcustomizedwebservices

Configuringadministrationknobs

Administrationknobsmustbeconfiguredtopointattheinstalledwebservice.

AboutthistaskNote:Itisnecessarytorestartservicesafterchangestoadminknobs.Thevalueoftheadminknobrequiresthatyouknowthelocationofthewebservice.Theformatoftheservicelocationthatisenteredasthevaluefortheadminknobisport:servicelocation.

Procedure1. Verifythelocationofthewebservice.2. Enterthelocationofthewebserviceaspartofthevaluefortheadminknobinthe

formatport:servicelocation.Forexample,ifthewebserviceURLishttp://localhost:9000/UpdateItemService.svc,theadminknobvaluemustbesetto9000:/UpdateItemService.svc.ItisdonewiththefollowingSQLcommand:updateadminknobs

IBMUnstructuredData751, p. 311

Page 321: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

setvalue='9000:/UpdateItemService.svc'wherename='sharepoint_custom_webservice_location';

IBMUnstructuredData751, p. 312

Page 322: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

SupportedfiletypesThefollowingsectionprovidesacomprehensivelistofthefiletypesthatcanbeharvestedandprocessedbyIBM®StoredIQPlatform,organizedbynameandbycategory.YoucanalsoviewSharePointattributes.

SupportedfiletypesbynameAllfiletypesbynamethatissupportedbyIBMStoredIQarelisted,includingcategory,format,extension,category,andversion.SupportedfiletypesbycategoryAllfiletypesbycategorythatissupportedbyIBMStoredIQarelisted,includingcategory,format,extension,andversion.SharePointattributesThefollowingsectiondescribesthevariousSharePointdataobjecttypesandtheirpropertiesthatarecurrentlysupportedbyIBMStoredIQPlatform.

IBMUnstructuredData751, p. 313

Page 323: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

SupportedfiletypesbynameAllfiletypesbynamethatissupportedbyIBM®StoredIQarelisted,includingcategory,format,extension,category,andversion.

Table1.Supportedfiletypesbyname

Format Extension Category Version

AdobeAcrobat PDF graphic2.13.0-7.0Japanese

AdobeFrameMakerGraphics FMV graphic vector/rasterthrough5.0

AdobeFrameMakerInterchangeFormat MIF

wordprocessing

3.0-6.0

AdobeIllustrator graphic Through7.09.0

AdobePhotoshop PSD graphic 4.0AmiDraw SDW graphic all

ANSI TXT textandmarkup 7-and8-bit

ASCII TXT textandmarkup 7-and8-bit

AutoCAD DWG CAD

2.5-2.69.0-14.0200220042005

AutoShadeRendering RND graphic 2.0

BinaryGroup3Fax graphic all

Bitmap BMP,RLE,ICO,CUR,DIB,WARP

graphic all

CALSRaster GP4 graphic TypeI,IIComma-SeparatedValues CSV spreads

heet

ComputerGraphicsMetafile CGM graphic

ANSICALSNIST3.0

CorelClipart CMX graphic 5-6CorelDraw CDR graphic 3.x-8.xCorelDraw(CDRwithTiffheader) graphic 2.x-9.x

CorelPresentations SHW presentation

Through12.0X3

CorelWordPerfect word Through12.0X3

IBMUnstructuredData751, p. 314

Page 324: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

CorelWordPerfectWindows WPD

wordprocessing

X3

DataEase Database 4.X

dBaseDatabase Database Through5.0

dBXL Database 1.3

DECWPSPLUS DXwordprocessing

Through4.0

DECWPSPLUS WPLwordprocessing

Through4.1

DisplayWrite(2and3) IP

wordprocessing

all

DisplayWrite(4and5)

wordprocessing

Through2.0

DOScommandexecutable COM system

Dynamiclinklibraryfiles DLL system

EBCDIC textandmarkup all

ENABLEwordprocessing

3.04.04.5

ENABLE Database

3.04.04.5

ENABLESpreadsheet SSF spreads

heet3.04.04.5

EncapsulatedPost-Script(raster) EPS graphic TIFFheader

Executablefiles EXE system

FirstChoice Database Through3.0

FirstChoicewordprocessing

Through3.0

FirstChoice spreadsheet Through3.0

FoxBase Database 2.1

Framework Database 3.0

Framework wordprocessi 3.0

IBMUnstructuredData751, p. 315

Page 325: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Framework processing

3.0

Framework spreadsheet 3.0

GEMBitImage IMG graphic allGraphicsInterchangeFormat GIF graphic all

GraphicsEnvironmentManager

GEMVDI graphic Bitmapandvector

Gzip GZ archive all

HaansoftHangul HWPwordprocessing

19972002

HarvardGraphics(DOS) graphic 2.x

3.x

HarvardGraphics(Windows) graphic all

Hewlett-PackardGraphicsLanguage HPGL graphic 2

HTML HTM textandmarkup Through3.0

IBMFFT textandmarkup all

IBMGraphicsDataFormat GDF graphic 1.0

IBMPictureInterchangeFormat PIF graphic 1.0

IBMRevisableFormText

textandmarkup all

IBMWritingAssistant

wordprocessing

1.01

InitialGraphicsExchangeSpec IGES graphic 5.1

Javaclassfiles CLASS systemJPEG(notinTIFFformat) JFIF graphic all

JPEG JPEG graphic all

JustSystemsIchitaro JTDwordprocessing

5.06.08.0-13.02004

JustSystemsWritewordprocessing

Through3.0

KodakFlashPix FPX graphic allKodakPhotoCD PCD graphic 1.0

Legacywordprocessi

ng

Through1.1

IBMUnstructuredData751, p. 316

Page 326: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

LegatoEmailExtender EMX Email

Lotus1-2-3 WK4 spreadsheet Through5.0

Lotus1-2-3(OS/2) spreadsheet Through2.0

Lotus1-2-3Charts 123 spreadsheet Through5.0

Lotus1-2-3forSmartSuite

spreadsheet 1997-Millennium9.6

LotusAMIPro SAMwordprocessing

Through3.1

LotusFreelanceGraphics PRZ present

ation ThroughMillennium

LotusFreelanceGraphics(OS/2) PRE present

ation Through2.0

LotusManuscriptwordprocessing

2.0

LotusNotes NSF EmailLotusPic PIC graphic allLotusSnapshot graphic all

LotusSymphony spreadsheet

1.01.12.0

LotusWordPro LWPwordprocessing

1996-9.6

LZASelfExtractingCompress archive all

LZHCompress archive allMacintoshPICT1/2 PICT1/PICT1 graphic BitmaponlyMacPaint PNTG graphic NA

MacWriteIIwordprocessing

1.1

MacromediaFlash SWF presentation textonly

MASS-11wordprocessing

Through8.0

MicrografxDesigner DRW graphic Through3.1MicrografxDesigner DSF graphic Win95,6.0MicrografxDraw DRW graphic Through4.0

MPEG-1Audiolayer3 MP3 multime

dia

ID3metadataonlyThesefilescanbeharvested,butthereisnodatainthemthatcanbeusedintags.

MSAccess MDB Database Through2.0

MSBinder archive 7.0-1997

IBMUnstructuredData751, p. 317

Page 327: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

MSExcel XLS spreadsheet 2.2-2007

MSExcelCharts spreadsheet 2.x-7.0

MSExcel(Macintosh) XLS spreads

heet

3.0-4.0199820012004

MSExcelXML XLSXspreadsheet

MSMultiPlan spreadsheet 4.0

MSOutlookExpress EML Email 1997-2003MSOutlookFormTemplate OFT Email 1997-2003

MSOutlookMessage MSG Email all

MSOutlookOfflineFolder OST Email 1997-2003

MSOutlookPersonalFolder PST Email 1997-2007

MSPowerPoint(Macintosh) PPT present

ation 4.0-2004

MSPowerPoint(Windows) PPT present

ation 3.0-2007

MSPowerPointXML PPTX presentation

MSProject MPP Database 1998-2003

MSWindowsXML DOCXwordprocessing

MSWord(Macintosh) DOC

wordprocessing

3.0-4.019982001

MSWord(PC) DOCwordprocessing

Through6.0

MSWord(Windows) DOCwordprocessing

Through2007

MSWordPadwordprocessing

all

MSWorks S30/S40 spreadsheet Through2.0

MSWorks WPSwordprocessing

Through4.0

MSWorks(Macintosh)

wordprocessi

ng

Through2.0

IBMUnstructuredData751, p. 318

Page 328: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

MSWorksDatabase(Macintosh)

Database Through2.0

MSWorksDatabase(PC)

Database Through2.0

MSWorksDatabase(Windows)

Database Through4.0

MSWritewordprocessing

Through3.0

MosaicTwin spreadsheet 2.5

MultiMate4.0wordprocessing

Through4.0

NavyDIFwordprocessing all

NotaBenewordprocessing

3.0

NovellPerfectWorks

wordprocessing

2.0

NovellPerfectWorks

spreadsheet 2.0

NovellPerfectWorks(Draw) graphic 2.0

NovellWordPerfectwordprocessing

Through6.1

NovellWordPerfect(Macintosh)

wordprocessing

1.02-3.0

OfficeWriterwordprocessing

4.0-6.0

OpenOfficeCalc SXC/ODS spreadsheet

1.12.0

OpenOfficeDraw graphic 1.12.0

OpenOfficeImpress SXI/SXP/ODP presentation

1.12.0

OpenOfficeWriter SXW/ODTwordprocessing

1.12.0

OS/2PMMetafileGraphics MET graphic 3.0

PaintShopPro6 PSP graphic 5.0-6.0ParadoxDatabase

(PC)

Databas

eThrough4.0

IBMUnstructuredData751, p. 319

Page 329: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Paradox(Windows) Database Through1.0

PC-FileLetterwordprocessing

Through5.0

PC-File+Letterwordprocessing

Through3.0

PCPaintBrush PCX,DCX graphic allPFS:ProfessionalPlan

spreadsheet 1.0

PFS:Writewordprocessing

A,B,C

PortableBitmapUtilities PBM graphic all

PortableGreymap PGM graphic NAPortableNetworkGraphics PNG graphic 1.0

PortablePixmapUtilities PPM graphic NA

PostScriptFile PS graphic levelII

ProfessionalWritewordprocessing

Through2.1

ProfessionalWritePlus

wordprocessing

1.0

ProgressiveJPEG graphic NA

Q&A(database) Database Through2.0

Q&A(DOS)wordprocessing

2.0

Q&A(Windows)wordprocessing

2.0

Q&AWritewordprocessing

3.0

QuattroPro(DOS) spreadsheet Through5.0

QuattroPro(Windows)

spreadsheet

Through12.0X3

R:BASE5000 Database Through3.1

R:BASE(Personal) Database 1.0

R:BASESystemV Database 1.0

RAR RAR archive

ReflexDatabase Database 2.0

RichTextFormat RTF textandmarkup

all

IBMUnstructuredData751, p. 320

Page 330: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

markup

SAMNAWordIVwordprocessing

SmartWareII Database 1.02

SmartWareIIwordprocessing

1.02

SmartWareII spreadsheet 1.02

Sprintwordprocessing

1.0

StarOfficeCalc SXC/ODS spreadsheet

5.26.x7.x8.0

StarOfficeDraw graphic5.26.x7.x8.0

StarOfficeImpress SXI/SXP/ODP presentation

5.26.x7.x8.0

StarOfficeWriter SXW/ODTwordprocessing

5.26.x7.x8.0

SunRasterImage RS graphic NASupercalcSpreadsheet

spreadsheet 4.0

TextMail(MIME) various Email

TotalWordwordprocessing

1.2

TruevisionImage TIFF graphic Through6TruevisionTarga TGA graphic 2

UnicodeText TXT textandmarkup all

UnixTAR(tapearchive) TAR archive NA

UnixCompressed Z archive NAUUEncoding UUE archive NA

vCardwordprocessing

2.1

Visio(preview) graphic 4

IBMUnstructuredData751, p. 321

Page 331: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Visio2003 graphic520002002

Volkswriterwordprocessing

Through1.0

through1.0

VPPlanner3D spreadsheet 1.0

WANGPCwordprocessing

Through2.6

WBMP graphic NAWindowsEnhancedMetafile EMF graphic NA

WindowsMetafile WMF graphic NAWinzip ZIP archive

WML textandmarkup 5.2

WordMARCwordprocessor

wordprocessing

ThroughComposer

WordPerfectGraphics WPG,WPG2 graphic Through2.0,7.and10

WordStarwordprocessing

Through7.0

WordStar2000wordprocessing

Through3.0

XBitmap XBM graphic x10XDump XWD graphic x10XPixmap XPM graphic x10

XML(generic) XML textandmarkup

XyWrite XY4wordprocessing

ThroughIIIPlus

Yahoo!IMArchive archiveZIP ZIP archive PKWARE-2.04g

Parenttopic:Supportedfiletypes

RelatedreferenceSupportedfiletypes

IBMUnstructuredData751, p. 322

Page 332: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

SupportedfiletypesbycategoryAllfiletypesbycategorythatissupportedbyIBM®StoredIQarelisted,includingcategory,format,extension,andversion.

Table1.SupportedarchivefiletypesbycategoryFormat Extension Version

Gzip GZ all

LZASelf-ExtractingComparess all

LZHCompress all

MSBinder 7.0-1997

RAR RAR

UnixTAR(tapearchive) TAR NA

UnixCompressed Z NA

UUEncoding UUE NA

Winzip Zip

Yahoo!IMArchive NA

ZIP ZIP PKWARE-2.04g

Table2.SupportedCADfiletypesbycategory

Format Extension Version

AutoCAD DWG

2.5-2.69.0-14.0200220042005

Table3.SupporteddatabasefiletypesbycategoryFormat Extension Version

DataEase 4.x

dBaseDataBase Through5.0

dBXL

1.3

IBMUnstructuredData751, p. 323

Page 333: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ENABLE 3.04.04.5

FirstChoice Through3.0

FoxBase 2.1

Framework 3.0

MSAccess MDB Through2.0

MSProject MPP Through2.0

MSWorksDatabase(Macintosh) 2.0

MSWorksDatabase(PC) Through2.0

MSWorksDatabase(Windows) Through4.0

ParadoxDatabase(PC) Through4.0

ParadoxDatabase(Windows) Through1.0

Q&A(database) Through2.0

R:BASE5000 Through3.1

R:BASE(personal) 1.0

R:BASESystemV 1.0

ReflexDatabase 2.0

SmartWareII 1.02

Table4.SupportedemailfiletypesbycategoryFormat Extension Version

LegatoEmailExtender EMX

LotusNotes NSF

MSOutlookExpress EML 1997-2003

IBMUnstructuredData751, p. 324

Page 334: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

MSOutlookFormTemplate OFT 1997-2003

MSOutlookMessage MSG all

MSOutlookOfflineFolder OST 1997-2003

MSOutlookPersonalFolder PST 1997-2007

TextMail(MIME) various

Table5.SupportedgraphicfiletypesbycategoryFormat Extension Version

AdobeAcrobat PDF2.13.0-7.0Japanese

AdobeFramemakerGraphics FMV vector/raster-5.0

AdobeIllustrator Through7.09.0

AdobePhotoshop PSD 4.0

AmiDraw SDW all

AutoShadeRendering RND 2.0

BinaryGroup3Fax all

Bitmap BMP,RLE,ICO,CUR,DIB,WARP all

CALSRaster GP4 TypeI,II

ComputerGraphicsMetafile CGMANSICALSNIST3.0

CorelCliart CMX 5-6

CorelDraw CDR 3.x-8.x

CorelDraw(CDRwithTIFF

2.x-9.x

IBMUnstructuredData751, p. 325

Page 335: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

header

EncapsulatedPostScript(raster) EPS TIFFheader

GEMBitImage IMG all

GraphicsInterchangeFormat GIF all

GraphicsEnvironmentManager GEMVDI Bitmapvector

HarvardGraphics(DOS) 2.x3.x

HarvardGraphics(Windows) all

Hewlett-PackardGraphicsLanguage HPGL 2

IBMGraphicsDataFormat GDF 1.0

IBMPictureInterchangeFormat PIF 1.0

JPEG(notinTIFFformat) JFIF all

JPEG JPEG all

KodakFlashPIX FPX all

KodakPhotoCD PCD 1.0

LotusPic PIC all

LotusSnapshot all

macintoshPICT1/2 PICT1/PICT2 Bitmaponly

MacPaint PNTG NA

MicrografxDesigner DRW Through3.1

MicrografxDraw DRW Through4.0

IBMUnstructuredData751, p. 326

Page 336: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

NovellPerfectWorks(Draw) 2.0

OpenOfficeDraw 1.12.0

OZ/2PMMetafileGraphics MET 3.0

PaintShopPro6 PSP 5.0-6.0

PCPaintbrush PCX,DCX all

PortableBitmapUtilities PBM all

PortableNetworkGraphics PNG 1.0

PortablePixmapUtilities PPM NA

Postscript PS LevelII

ProgressiveJPEG NA

StarOfficeDraw 5.26.x7.x8.0

SunRasterImage RS NA

TruevisionImage TIFF Through6

TruevisionTarga TGA 2

Visio 4

Visio2003 520002002

WBMP NA

WindowsEnhancedMetafile EMF NA

WindowsMetafile WMF NA

IBMUnstructuredData751, p. 327

Page 337: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

WordPerfectGraphics WPG,WPG2Through2.0710

XBitmap XBM x10

XDump XWD x10

XPixmap XPM x10

Table6.Supportedmultimediafiletypesbycategory

Format Extension Version

MPEG-1AudioLayer3

MP3

ID3metadataonlyNote:Thesefilescanbeharvested,butthereisnodatainthemthatcanbeusedintags.

Table7.SupportedpresentationfiletypesbycategoryFormat Extension Version

CorelPresentations SHW Through12.0X3

LotusFreelanceGraphics PRZ ThroughMillennium

LotusFreelanceGraphics(OS/2) PRE Through2.0

MacromediaFlash SWF textonly

MSPowerPoint(Macintosh) PPT 4.0-2004

MSPowerPoint(Windows) PPT 3.0-2007

MSPowerPointXML PPTX

OpenOfficeImpress SXI/SXP/ODP1.12.0

StarOfficeImpress SXI/SXP/ODP5.26.x7.x8.0

Table8.SupportedspreadsheetfiletypesbycategoryFormat Extension Version

Comma-SeparatedValuesCSV

IBMUnstructuredData751, p. 328

Page 338: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Comma-SeparatedValues

ENABLESpreadsheet SSF3.04.04.5

FirstChoice Through3.0

Framework 3.0

Lotus1-2-3 WK4 Through5.0

Lotus1-2-3(OS/2) Through2.0

Lotus1-2-3Charts 123 Through5.0

Lotus1-2-3forSmartSuite 197-9.6

LotusSymphony 1.01.12.0

MSExcel XLS 2.2-2007

MSExcelCharts 2.x-7.0

MSExcel(Macintosh) XLS3.0-4.0199820012004

MSExcelXML XLSX

MSMultiPlan 4.0

MSWorks S30/S40 Through2.0

MosaicTwin 2.5

NovellPerfectWorks 2.0

OpenOfficeCalc SXC/ODS 1.12.0

PFS:ProfessionalPlan 1.0

IBMUnstructuredData751, p. 329

Page 339: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

QuattroPro(DOS) Through5.0

QuattroPro(Windows) Through12.0X3

SmartWareII 1.02

StarOfficeCalc SXC/ODS5.26.x7.x8.0

SupercalcSpreadsheet 4.0

VPPlanner3D 1.0

Table9.Supportedsystemfiletypesbycategory

Format Extension

Executablefiles .EXE

Dynamiclinklibraryfiles .DLL

Javaclassfiles .class

DOScommandexecutables .COM

Table10.SupportedtextandmarkupfiletypesbycategoryFormat Extension Version

ANSI .TXT 7-and8-bit

ASCII .TXT 7-and8-bit

EBCDIC all

HTML .HTM Through3.0

IBMFFT all

IBMRevisableFormText all

RichTextFormat RTF all

UnicodeText .TXT all

IBMUnstructuredData751, p. 330

Page 340: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

WML 5.2

XML .XML

Table11.Supportedword-processingfiletypesbycategoryFormat Extension Version

AdobeFrameMakerInterchangeFormat MIF 3.0-6.0

CorelWordPerfectWindows WPD Through12.0X3

DECWPSPLUS DX Through4.0

DECWPSPLUS WPL Through4.1

DisplayWrite(2and3) IP all

DisplayWrite(4and5) Through2.0

ENABLE 3.04.04.5

FirstChoice Through3.0

Framework 3.0

HaansoftHangul HWP 19972002

IBMWritingAssistant 1.01

JustSystemsIchitaro JTD

5.06.08.0-13.02004

JustSystemsWrite Through3.0

Legacy Through1.1

LotusAMIPro SAM Through3.1

LotusManuscript 2.0

IBMUnstructuredData751, p. 331

Page 341: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

LotusManuscript 2.0

LotusWordPro LWP 1996-9.6

MacWriteII 1.1

MASS-11 Through8.0

MSWindowsXML DOCX

MSWord(Macintosh) DOC3.0-4.019982001

MSWord(PC) DOC Through6.0

MSWord(Windows) DOC Through2007

MSWordPad allversion

MSWorks WPS Through4.0

MSWorks(Macintosh) Through2.0

MSWrite Through3.0

MultiMate4.0 Through4.0

NavyDIF allversions

NotaBene 3.0

NovellPerfectWorks 2.0

NovellWordPerfect Through6.1

NovellWordPerfect(Macintosh) 1.02-3.0

OfficeWriter 4.0-6.0

OpenOfficeWriter SXW/ODT 1.12.0

PC-FileLetter Through5.0

IBMUnstructuredData751, p. 332

Page 342: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

PC-FileLetter Through5.0

PC-File+Letter Through3.0

PFSWrite ABC

ProfessionalWritePlus Through2.1

Q&A(DOS) 2.0

Q&A(Windows) 2.0

Q&AWrite 3.0

SAMNAWordIV

SmartWareII 1.02

Sprint 1.0

StarOfficeWriter SXW/ODT5.26.x7.x8.0

TotalWord 1.2

Parenttopic:Supportedfiletypes

RelatedreferenceSupportedfiletypes

IBMUnstructuredData751, p. 333

Page 343: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

SharePointattributesThefollowingsectiondescribesthevariousSharePointdataobjecttypesandtheirpropertiesthatarecurrentlysupportedbyIBM®StoredIQPlatform.

SupportedSharePointobjecttypesThesetypesofSharePointobjectsaresupported:

Table1.SupportedSharePointobjecttypesSupportedSharePoint

objecttypesSupportedSharePoint

objecttypesSupportedSharePoint

objecttypes

Blogpostsandcomments Discussionboard Calendar

Tasks Projecttasks Contacts

Wikipages Issuetracker Announcements

Survey Links Documentlibraries

Picturelibraries Recordscenter

NotesregardingSharePointobjecttypesCalendar:RecurringcalendareventsareindexedasasingleobjectinIBMStoredIQPlatform.EachrecurringcalendareventhasmultipleEventDateandEndDateattributevalues,onepairperrecurrence.Forinstance,ifthereisaneventdefinedforAmericanIndependenceDayandissettorecuryearly,itisindexedwithEventDates2010-07-04,2011-07-04,2012-07-04,andsoon.Survey:Onlyindividualresponsestoasurveyareindexedassystem-levelobjects.Eachresponseisauser'sfeedbacktoallquestionsinthesurvey.EachquestioninthesurveythatwasansweredforaresponseisindexedasanattributeoftheresponseintheIBMStoredIQPlatformindex.Thenameoftheattributeisthestringthatformsthequestionwhilethevalueisthereplyentered.Surveyshavenofull-textindexablebody,andtheyarealwaysindexedwithsize=0.

HashcomputationThehashofafull-textindexedobjectiscomputedwiththefull-textindexablebodyoftheobject.However,inthecaseofSharePointlistitemobjects(excludingdocumentsandpictures),thefull-textindexablebodymightbeemptyortoosimplistic.Itmeansthatyoucaneasilyobtainduplicateitemsacrossotherwisetwodifferentobjects.Forthisreason,otherattributesareincludedinthehashcomputationalgorithm.

TheseattributesareincludedwhilethehashiscomputedfortheSharePointdataobjects,excludingdocumentsandpictures.

Table2.AttributesummaryAttribute Types

GenericattributesTitle(SharePoint)Contenttype(SharePoint)Description(SharePoint)

IBMUnstructuredData751, p. 334

Page 344: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Blogpostattributes Postcategory(SharePoint)

Wikipageattributes Wikipagecomment

Calendareventattributes

Eventcategory(SharePoint)Eventdate(SharePoint)Eventenddate(SharePoint)Eventlocation(SharePoint)

Taskorprojecttaskattributes

Taskstartdate(SharePoint)Taskduedate(SharePoint)Taskthatisassignedto(SharePoint)

Contactattributes

Contactfullname(SharePoint)Contactemail(SharePoint)Contactjobtitle(SharePoint)Contactworkaddress(SharePoint)Contactworkphone(SharePoint)Contacthomephone(SharePoint)Contactmobilephone(SharePoint)

Linkattributes LinkURL(SharePoint)

Surveyattributes Allsurveyquestionsandanswersintheresponseareincludedinthehash.

Parenttopic:Supportedfiletypes

RelatedreferenceSupportedfiletypes

IBMUnstructuredData751, p. 335

Page 345: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

SupportedserverplatformsandprotocolsThefollowingsectionliststhesupportedserverplatformsbyvolumetypeandtheprotocolsforsupportedsystems.

PrimaryvolumeAprimaryvolumeisstorageknowledgeworkersaccesstocreate,read,update,anddeleteunstructuredcontent.Unstructuredcontentisstoredinstandardformatssuchasofficedocuments,textfiles,systemlogs,applicationlogs,email,compressedarchivesthatcontainemail,documents,orenterprisesocialmediacontent.

RetentionvolumeGenerally,aretentionvolumeisimmutablestoragethatenforcesretentionandholdpolicies.Whiledataisundermanagement,itcannotbemodifiedordeleted,andknowledgeworkerstypicallydonotaccessretentionstoragedirectly.SpecificapplicationssuchasIBM®StoredIQeDiscoverymovedatatothisstoragetomanageit.ThisstoragetypicallyhasitsownspecialAPI/protocol,althoughNASvendorsimplementedretention/holdfeaturesthatusestandardCIFSandNFSprotocols(NetAppSnapLockorEMCCelerraFLRarespecificexamples).Thestorageplatformtypicallydoesnotimplementahierarchicalnamespacetostorecontent,butinsteadreliesonagloballyuniqueidentifierasahandletometadataandcontent.Applicationsarefreetowritemetadataandbinarycontentinanyinternalformattosatisfytheirrequirements.Typically,IBMStoredIQdoesnotattempttodiscoverandmanagedatathatiswrittenbyotherapplicationstoretentionvolumes.Application-specificknowledgeisoftenrequiredtointerpretmetadataandcontent.RetentionstorageisusedbyIBMStoredIQtomanagedataoncompliantimmutablestorageforretentionandholds.Itdoessoinawaythatdoesnotinterferewithknowledgeworkersthatcreate,update,andaccesscontentonprimaryvolumes.IBMStoredIQpreservessourcemetadatawhendataiswrittentoaretentionvolume.Theoriginalsourcemetadataisimportantforgovernanceandlegaldiscovery(custodian,timestamps,andsoon)toreplicatethecontentandmetadatafromtheretentionvolumewhenneeded.

ExportvolumeExportvolumesareunmanaged(notindexed)storagelocationwherecontentiscopiedalongwithmetadataandauditdetailinaformatthatcanbeimportedbyotherapplications.AcommonusageofexportvolumesistostagenativedocumentstobeimportedintoalegalreviewtoolinaformatsuchasstandardEDRMoraConcordance-compatibleformat.

SystemvolumeSystemvolumesareastoragelocationwherefilescanbewrittentoandreadbyIBMStoredIQ.ItcanbeusedtoexportvolumemetadatathatiscontainedintheindexonaDataServer.Exportedvolumedatacanbeimportedfromasystemvolumetopopulateavolumeindex.

Table1.SupportedplatformsandprotocolsbyIBMStoredIQvolumetype

Platform/protocol

IBMStoredIQprimaryvolume

IBMStoredIQretentionvolume

IBMStoredIQexportvolume

IBMStoredIQsystemvolume

Notes

CIFS x x x x EMCCelerraFLR x

EMCCentera x

EMCDocumentum x x

CustomermustsupplyDFCfilestoenablethe

connector.HitachiHCAP x IBMInformation x

IBMUnstructuredData751, p. 336

Page 346: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

InformationArchive(DR550)

x

IBMDomino x Emailonly.IBMFileNet x Jive x MicrosoftExchange x

MicrosoftSharePoint x

NetAppSnapLock x

NewsGator x NFS x x x x OpenTextLivelink/ContentServer

x

SalesforceChatter x

SymantecDiscoveryAccelerator

x

SymantecEnterpriseVault

x x

Table2.Supportedoperationsandlimitationsbyplatformandprotocol

Platform/protocol

Operationtype:read

Operationtype:write

Operationtype:delete

Notes

CIFS R W D EMCCelerraFLR

R W D Treatedasretentionvolume;onlycontentwrittenbyIBMStoredIQissupported.

EMCCentera R W D

MetadataandcontentwrittenbyIBMStoredIQorEMCEmailXtenderissupported.EmailXtendersupportislimitedtoemailarchivedfromExchange.

EMCDocumentum

R W D OnlyCurrentdocumentsinstandardcabinetsareindexed.

HitachiHCAP R W D

IBMInformationArchive(DR550)

R W D

IBM

DominoR Emailonly.Emailisconvertedtothe.MSGformatfor

processing.IBMFileNet W

Jive R MicrosoftExchang R Messages(email),Contacts,Calendaritems,Notes,Tasks,and

Documents

IBMUnstructuredData751, p. 337

Page 347: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Exchange

Documents

MicrosoftSharePoint

R W

Alldocumentversionsareoptional.

SharePoint2010/2013supportedlisttypes:Userprofiles,Usernotes,BlogPost,BlogComment,DiscussionPost,DiscussionReply,WikiPage,Calendar,Task/ProjectTask,Contact,IssueTracker,Survey,Link,andAnnouncements.

Contentofcustomlistsisindexedgenericallyastext.Itisnotmodeledspecifically,likestandardlisttypes.

NetAppSnapLock

R W D Treatedasretentionvolume;onlycontentwrittenbyIBMStoredIQissupported.

NewsGator R NoAPIsupportforPollresponses.

NFS R W D OpenTextLivelink/ContentServer

R

SalesforceChatter

R

SymantecDiscoveryAccelerator

R

SymantecEnterpriseVault

R W D ThedeleteactionisonlysupportedforretentionvolumesandonlymetadataandcontentwrittenbyIBMStoredIQ.

Table3.SupportedCIFSserverplatformandprotocolversions(read/write/delete)

CIFSserver NotesWindowsXP,Vista,7 WindowsServer2003,2008,2008R2 Samba NetAppONTAP7.0.0orlater EMCCelerraDART5.5orlater MacOSX,10.7,10.8,10.9 Table4.SupportedEMC

Centeraserverplatformandprotocolversions(read/write)EMCCenteraserver NotesCenteraAPIv3.1 Table5.SupportedEMCDocumentumserverplatformandprotocolversions(read/write)

EMCDocumentumserver Notes

Documentum6.0,6.5,6.7 CustomermustsupplyDFCfilestoenabletheconnector.

DocumentumwithRetentionPolicyServices(RPS)6.0,6.5

CustomermustsupplyDFCfilestoenabletheconnector.

IBMUnstructuredData751, p. 338

Page 348: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Table6.SupportedIBMFileNetserverplatformandprotocolversions(write)

FileNetcontentservices NotesFileNet5.3 WebDAVprotocolTable7.SupportedHitachiHCAP

serverplatformandprotocolversions(read/write/delete)

HitachiHCAPservice NotesHitachiContentPlatformv1.8

Table8.SupportedIBMDomino/Notesserverplatformand

protocolversions(read)IBMDomino/Notesserver NotesDomino/Notes6.x,7.x,8.x

Table9.SupportedIBMInformationArchiveserver

platformandprotocolversions(read/write/delete)

IBMInformationArchive NotesTSMClient5.3.4.0

Table10.SupportedJive

serverplatformandprotocolversions

(read)Jiveservice NotesJive5.0.2 Table11.SupportedMicrosoftExchangeserverplatformand

protocolversions(read)MicrosoftExchangeserver NotesExchange2003 WebDAVprotocolExchange2007,2010 ExchangewebserviceinterfaceTable12.SupportedMicrosoftSharePointserverplatformand

protocolversions(read/write)MicrosoftSharePointserver NotesSharePoint2003 WebDAVprotocolSharePoint2007,2010,2013 SharePointwebserviceinterfaceTable13.SupportedNewsGatorserverplatformandprotocol

versions(read)NewsGatorAPI Notes

NewsGatorSocial2.1.1229 InstalledonSharePoint2010orlater.Table14.SupportedNFSserverplatformandprotocolversions

(read/write/delete)NFSv3 Notes

RedHatEnterpriseLinux5.x,6.x CentOS5.x,6.x NetAppONTAP7.0.0orlater EMCCelerraDART5.5orlater MacOSX,10.7,10.8,10.9 Table15.SupportedOpenTextLivelinkEnterpriseServerplatformandprotocolversions

(read)

LivelinkEnterpriseServer Notes

IBMUnstructuredData751, p. 339

Page 349: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

LivelinkEnterpriseServer Notes

OpenTextLivelinkEnterpriseServer9.7,9.7.1

ConnectorisbasedonIBMContentIntegrator(ICI)version8.6.

Table16.SupportedOpenTextContentServerplatformandprotocolversions(read)ContentServer Notes

ContentServer10.0.0 ConnectorisbasedonIBMContentIntegrator(ICI)version8.6.Table17.SupportedSalesforceChatterserverplatformandprotocolversions(read)

SalesforceChatterservice NotesSalesforcePartnerAPIv26.0 Table18.SupportedSymantecDiscoveryAcceleratorserverplatformandprotocolversions

(read)SymantecDiscoveryAccelerator

server Notes

EnterpriseVaultDCOMAPI8.0.3,9.0,10.0

QuerycontentandmetadatafromDiscoveryAcceleratorcases.

Table19.SupportedSymantecEnterpriseVaultserverplatformandprotocolversions(read/write)

SymantecEnterpriseVaultserver NotesEnterpriseVaultDCOMAPI8.0.3,9.0,10.0

IBMUnstructuredData751, p. 340

Page 350: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

EventlogmessagesThefollowingsectioncontainsacompletelistingofallERROR,INFO,andWARNevent-logmessagesthatappearintheEventLogoftheIBM®StoredIQPlatformconsole.

ERROReventlogmessagesThefollowingtablecontainsacompletelistingofallERRORevent-logmessages,reasonsforoccurrence,samplemessages,andanyrequiredcustomeraction.INFOeventlogmessagesThefollowingtablecontainsacompletelistingofallINFOevent-logmessages.WARNeventlogmessagesThefollowingtablecontainsacompletelistingofallWARNevent-logmessages,reasonsforoccurrence,samplemessages,andanyrequiredcustomeraction.

RelatedreferenceERROReventlogmessagesINFOeventlogmessagesWARNeventlogmessages

IBMUnstructuredData751, p. 341

Page 351: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ERROReventlogmessagesThefollowingtablecontainsacompletelistingofallERRORevent-logmessages,reasonsforoccurrence,samplemessages,andanyrequiredcustomeraction.

Table1.ERROReventlogmessages.ThistablelistsallERRORevent-logmessages..

Type

Eventnumber

Reason Samplemessage Requiredcustomeraction

ERROR

1001

Harvesterwasunabletoopenasocketforlisteningtochildprocesses.

Harvestercouldnotallocatelistenportafter<number>attempts.Cannotkickstartinterrogators.(1001)

LogintoUTILandrestarttheapplicationserver.Restartthedataserver.ContactCustomerSupport.

ERROR

9083

Unexpectederrorwhileitisexportingavolume.

Exportingvolume'dataserver:/mnt/demo-A'(1357)hasfailed(9083)

ContactCustomerSupport.

ERROR

9086

Unexpectederrorwhileitisimportingavolume

Importingvolume'dataserver:/mnt/demo-A'(1357)failed(9086)

ContactCustomerSupport.

ERROR

15001

Novolumesareabletobeharvestedinajob.Forinstance,allofthemountsfailduetoanetworkissue.

Novolumesharvested.(15001)

MakesureIBM®StoredIQPlatformstillhasappropriatepermissionstoavolume.Verifythatthereisnetworkconnectivitybetweenthedataserverandyourvolume.ContactCustomerSupport.

ERROR

15002

Couldnotmountthevolume.Checkpermissionsandnetworksettings.

Errormountingvolume<share><start-dir>onserver<server-name>.Reported<reason>.(15002)

Makesurethatthedataserverstillhasappropriatepermissionstoavolume.Verifythatthereisnetworkconnectivitybetweenthedataserverandyourvolume.ContactCustomerSupport.

E 1 Failedto

IBMUnstructuredData751, p. 342

Page 352: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ERROR

15021

Errorsavingharvestrecord.

saveHarvestRecordforqa1:auto-A(15021)

ContactCustomerSupport.Thismessageoccursduetoadatabaseerror.

ERROR

17001

UnhandledunrecoverableexceptioninCenteraDiscovery.

CenteraHarvesterfatalfailure:<exceptiondescription>(17001)

ContactCustomerSupport.

ERROR

17012

AnerroroccurredwhenavolumewascreatedduringCenteraDiscovery.

UnabletocreateCenteraVolumeCompany_jpool_2009_FEB_1inpooljpool.Error:<databaseerrordescription>(17012)

ContactCustomerSupport.Thismessageoccursduetoadatabaseerror.

ERROR

17501

Genericretentiondiscoveryfailedinacatastrophicmanner.

Genericretentiondiscoveryfatalfailure:<17501>

ContactCustomerSupport.

ERROR

17503

Genericretentiondiscoverycreatesvolumesetsassociatedwithprimaryvolumes.Whenthatfails,IBMStoredIQPlatformsendsthismessage.Thisfailurelikelyoccurredduetodatabaseerrors.

Errorcreating/loadingvolumesetfor<server>:<share>

ContactCustomerSupport.

ERROR

17505

Unabletoqueryobjectcountforadiscoveredvolumeduetoadatabaseerror.

Unabletodetermineobjectcountfor<server>:<share>

ContactCustomerSupport.

ERROR

17506

Genericretentiondiscoverycouldnotcreatediscoveredvolume.

Errorcreatingvolume<server>:<share:>

ContactCustomerSupport.

ERROR

18001

SMBconnectionfails.

WindowsShareProtocolExceptionwhenconnectingtotheserver<server-name>:<reason>.(18001)

MakesureIBMStoredIQPlatformstillhasappropriatepermissionstoavolume.Verifythatthereisnetworkconnectivitybetweenthedataserverandyourvolume.ContactCustomerSupport.

IBMUnstructuredData751, p. 343

Page 353: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ERROR

18002

TheSMBvolumemountfailed.Checkthesharename.

WindowsShareProtocolExceptionwhenconnectingtotheshare<share-name>on<server-name>:<reason>.(18002)

Verifythenameoftheserverandvolumetomakesurethattheyarecorrect.Ifthismessagepersists,thencontactCustomerSupport.

ERROR

18003

Thereisnovolumemanager.

WindowsShareProtocolExceptionwhileinitializingthedataobjectmanager:<reason>.(18003)

ContactCustomerSupport.

ERROR

18006

Grazervolumecrawlthrewanexception.

Grazer._run:Unknownerrorduringwalk.(18006)

Verifytheuserthatmountedthespecifiedvolumehaspermissionsequivalenttoyourcurrentbackupsolution.Ifthismessagecontinues,contactCustomerSupport.

ERROR

18021

AnunexpectederrorfromtheserverpreventedtheharvesttoreachtheendoftheactivitystreamontheNewsGatordatasourcethatisharvested.Thenextincrementalharvestattemptstopickupfromwherethecurrentharvestwasinterrupted.

UnabletofetchtrailingactivitystreamfromNewsGatorvolume.Willretryinnextharvest.(18021)

ChecktoensuretheNewsGatorserverhassufficientresources(diskspace,memory).Itislikelythatthiserroristransient.Iftheerrorpersistsacrossmultipleharvests,contactCustomerSupport.

ERROR

18018

Startdirectoryhasescapecharacters,andthedataserverisconfiguredtoskipthem.

Cannotgrazethevolume,rootdirectoryNunezhasescapecharacters(18018)

Considerturningoffescapecharacterchecking.

ERROR

19001

Anexceptionoccurredduringinterrogatorinitialization.

Interrogator._init__exception:<reason>.(19001)

ContactCustomerSupport.

ERROR

19002

Anunknownexceptionoccurredduringinterrogatorinitialization.

Interrogator.__init__exception:unknown.(19002)

ContactCustomerSupport.

ER19 Anexceptionoccurred

Interrogator.pro-cessexception

IBMUnstructuredData751, p. 344

Page 354: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ROR

003

duringinterrogatorprocessing.

(<volumeid>,<epoch>):<reason>.(19003)

ContactCustomerSupport.

ERROR

19004

Anunknownexceptionoccurredduringinterrogatorprocessing.

Interrogator.pro-cessexception(<volumeid>,<epoch>).(19004)

ContactCustomerSupport.

ERROR

19005

Anexceptionoccurredduringviewerinitialization.

Viewer.__init__:Exception-<reason>.(19005)

ContactCustomerSupport.

ERROR

19006

Anunknownexceptionoccurredduringviewerinitialization.

Viewer.__init__:Unknownexception.(19006)

ContactCustomerSupport.

ERROR

33004

Volumecouldnotbeunmounted.

Unmountingvolumefailedfrommountpoint:<mountpoint>.(33004)

Restartthedataserver.Iftheproblempersists,thencontactCustomerSupport.

ERROR

33005

Dataserverwasunabletocreatealocalmountingpointforthevolume.

Unabletocreatemount_pointusingprimitive.thread-Safe-Makedirs().(33005)

Restartthedataserver.Iftheproblempersists,thencontactCustomerSupport.

ERROR

33010

FailedtomakeSMBconnectiontoWindowsShareserver.

MountingWindowsSharevolumefailedwiththeerror:<systemerrormessage>.(33010)

Verifyusernameandpasswordthatisusedformountingthevolumeareaccurate.Checktheuserdataobjectforappropriatepermissionstothevolume.Makesurethatthevolumeisaccessiblefromoneofthebuilt-inprotocols(WindowsShare).Verifythatthenetworkisproperlyconfiguredforthedataservertoreachthevolume.VerifythatthedataserverhasappropriateDNSsettingstoresolvetheservername.

ERROR

33011

Internalerror.Problemaccessinglocal/proc/mounts

Unabletoopen/proc/mounts.Cannottestifvolumewasalreadymounted.(33011)

Restartthedataserver.Iftheproblempersists,thencontactCustomerSupport.

ERR

O

330

1

Databaseproblemswhenavolumewasdeleted.

AnexceptionoccurredwhileworkingwithHARVESTS_TABLEin

ContactCustomerSupport.

IBMUnstructuredData751, p. 345

Page 355: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

R 2 Volume._delete().(33012)

ERROR

33013

Novolumesetwasfoundforthevolumessetname.

Unabletoloadvolumesetbyitsname.(33013)

ContactCustomerSupport.

ERROR

33014

Systemcouldnotdeterminewhenthisvolumewaslastharvested.

Anerroroccurredwhileperformingthelast_harvestoperation.(33014)

ContactCustomerSupport.

ERROR

33018

AnerroroccurredmountingtheExchangeshare.

MountingExchangeServerfailed:<reason>.(33018)

Verifyusernameandpasswordthatisusedformountingtheshareareaccurate.Checkforappropriatepermissionstotheshare.Makesurethattheshareisaccessible.Verifythatthenetworkisproperlyconfiguredforthedataservertoreachtheshare.VerifythatthedataserverhasappropriateDNSsettingstoresolvetheservername.

ERROR

33019

FailedtoconnectandauthenticatetotheHitachiArchivasContentArchiveserver.

MountingHCAPvolumefailed:CannotconnecttoHCAPshare.(33019)

Ensuretheconnectivity,credentials,andpermissionstotheHitachivolumeandtryagain.

ERROR

33020

FailedtoconnectandauthenticatetotheIBMInformationArchiveretentionvolume.

MountingIBMInformationArchivevolumefailedwiththeerror:Serverunreachable.(33020)

Ensuretheconnectivity,credentials,andpermissionstotheIBMInformationArchivevolumeandtryagain.

ERROR

33022

FailedtoconnecttotheDiscoveryAcceleratorwiththeinformationfortheVolume.

MountingDiscoveryAcceleratorvolumefailedwiththeerror:insufficientpermissionstoreviewCaseOne(33022)

Verifytheinformationthatisusedtoaddthevolumeandensurethatalldetailsareenteredcorrectlybeforeyoutryitagain.Iftheerrorpointstonetworkissueswithconnectivity,addressthemandtryagain.

ERROR

33027

TheattempttoconnectandauthenticatetotheIBMFileNetserverfailed.

MountingIBMFileNetvolumefailed:<reason>.(33027)

Ensuretheconnectivity,credentials,andpermissionstotheFileNetvolumeandtryagain.

ER33 Failedtocreatethevolume

Exceeded

maximum ContactCustomerSupport.

IBMUnstructuredData751, p. 346

Page 356: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ROR

029

asthenumberofactivevolumepartitionsexceedsthelimitof500.

numberofvolumepartitions(33029).

ContactCustomerSupport.

ERROR

34002

Couldnotcompletethecopyactionbecausethetargetdiskwasfull.

CopyActionabortedasthetargetdiskhasrunoutofspace(34002)

Verifythatthereisspaceavailableonyourpolicydestinationandtryagain.

ERROR

34009

Couldnotcompletethemoveactionduetofulltargetdisk.

MoveActionabortedasthetargetdiskhasrunoutofspace.(34009)

Verifythatthereisspaceavailableonyourpolicydestination,thenrunanotherharvestbeforeyourunthepolicy.Whentheharvestcompletes,tryrunningthepolicyagain.

ERROR

34015

Thepolicyauditcouldnotbedeletedforsomereason.

ErrorDeletingPolicyAudit:<errormessage>(34016)

ContactCustomerSupport.

ERROR

34020

ThecopytoCenteraactioncouldnotberunbecauseofinsufficientpermissions.

CopytoCenterafailedaswedonothaveread/writepermissionsontheaccessprofileused.(34020)

CheckpermissionsontheaccessprofilethatisprovidedfortheCenterapoolonwhichthevolumeisdefined,andcheckwhethertheappropriatepermissionsareprovided.

ERROR

34021

ThemovetoCenteraactioncouldnotberunbecauseofinsufficientpermissions.

MovetoCenterafailedaswedonothaveread/writepermissionsontheaccessprofileused.(34020)

CheckpermissionsontheaccessprofilethatisprovidedfortheCenterapoolonwhichthevolumeisdefined,andcheckwhethertheappropriatepermissionsareprovided.

ERROR

34030

Discoveryexportpolicyisstartedsinceitdetectedthetargetdiskisfull.

ProductionRunactionabortedbecausethetargetdiskhasrunoutofspace.(34030)

Createsufficientspaceontargetdiskandrundiscoveryexportpolicyagain.

ERROR

34034

Thetargetvolumeforthepolicycouldnotbemounted.Thepolicyisstarted.

Copyobjectsfailed,unabletomountvolume:QA1.COMPANY.COM:SHARE.(34034)

Ensuretheconnectivity,logincredentials,andpermissionstothetargetvolumeforthepolicyandtryagain.

ERR

410 Thejobisended

<job-name>

ended Trytorunthejobagain.Ifitfailsagain,

IBMUnstructuredData751, p. 347

Page 357: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

OR04

abnormally. unexpectedly.(41004)

contactCustomerSupport.

ERROR

41007

Jobfailed.[Jobname]hasfailed(41007).

LookatpreviousmessagestoseewhyitfailedandrefertothatmessageIDtopinpointtheerror.ContactCustomerSupport.

ERROR

42001

Thecopyactioncouldnotrunbecauseofparametererrors.

Copydataobjectsdidnotrun.Errorsoccurred:<error-description>.(42001)

ContactCustomerSupport.

ERROR

42002

Thecopyactionwasunabletocreateatargetdirectory.

Copydataobjectsfailed,unabletocreatetargetdir:<target-directory-name>.(42002)

Checkpermissionsonthetarget.Makesurethepermissionsthatareconfiguredtomountthetargetvolumehavewriteaccesstothevolume.

ERROR

42004

Anunexpectederroroccurred.

Copydataobjectsterminatedabnormally.(42004)

ContactCustomerSupport.

ERROR

42006

Themoveactioncouldnotrunbecauseofparametererrors.

Movedataobjectsdidnotrun.Errorsoccurred:<error-description>.(42006)

ContactCustomerSupport.

ERROR

42007

Themoveactionwasunabletocreateatargetdirectory.

Movedataobjectsfailed,unabletocreatetargetdir:<target-directory-name>.(42007)

Checkpermissionsonthetarget.Makesurethepermissionsthatareconfiguredtomountthetargetvolumehavewriteaccesstothevolume.

ERROR

42009

Anunexpectederroroccurred.

Movedataobjectsterminatedabnormally.(42009)

ContactCustomerSupport.

ERROR

42017

Anunexpectederroroccurred.

Deletedataobjectsterminatedabnormally.(42017)

ContactCustomerSupport.

ER42 Thepolicyactioncouldnot

Policycannotexecute.

IBMUnstructuredData751, p. 348

Page 358: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ROR

025

runbecauseofparametererrors.

Attributeverificationfailed.(42025)

ContactCustomerSupport.

ERROR

42027

Anunexpectederroroccurred.

Policyterminatedabnormally.(42027)

ContactCustomerSupport.

ERROR

42050

Thedatasynchronizercouldnotrunbecauseofanunexpectederror.

ContentDataSynchronizersynchronizationof<server-name>:<volume-name>failedfatally.

ContactCustomerSupport.

ERROR

42059

Invalidsetofparametersthatarepassedtodiscoveryexportpolicy.

ProductionRunonobjectsdidnotrun.Errorsoccurred:Thefollowingparametersaremissing:action_limit.(42059)

ContactCustomerSupport.

ERROR

42060

Discoveryexportpolicyfailedtocreatetargetdirectoryfortheexport.

ProductionRunonobjects(Copyingnativeobjects)failed,unabletocreatetargetdir:production/10.(42060)

Verifythatthediscoveryexportvolumehaswritepermissionandre-executepolicy.

ERROR

42062

Discoveryexportpolicywasendedabnormally.

ProductionRunonobjects(Copyingnativeobjects)terminatedabnormally.(42062)

ContactCustomerSupport.

ERROR

42088

Thefull-textoptimizationprocessfailed;however,theindexismostlikelystillusableforqueries.

Full-textoptimizationfailedonvolume<volume-name>(42088)

ContactCustomerSupport.

Timeallocatedto

IBMUnstructuredData751, p. 349

Page 359: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ERROR

45802

Afull-textindexisalreadybeingmodified.

gainexclusiveaccesstoin-memoryindexforvolume=1357hasexpired(45802)

ContactCustomerSupport.

ERROR

45803

Theindexforthespecifiedvolumedoesnotexist.Thismessagecanoccurundernormalconditions.

Index'/deepfs/full-text/volume_index/volume_1357'notfound.(45803)

Nouserinterventionisrequired.

ERROR

45804

Programmingerror.Atransactionwasneverinitiatedorwasclosedearly.

Transactionofclient:node.client.com_FINDEX_QUEUE_1357_117251522_3_2isnotthewriter(45804)

ContactCustomerSupport.

ERROR

45805

Thequeryisnotstartedorexpired.Theformerisaprogrammingerror.Thelatterisnormal.

QueryID:123doesnotexist(45805)

Nouserinterventionisrequired.

ERROR

45806

Thequeryexpressionisinvalidornotsupported.

Failedtoparse'dogpre\3bar'(45806)

Reviseyourfull-textquery.

ERROR

45807

Programmingerror.Atransactionwasalreadystartedfortheclient.

Client:node.client.com_FINDEX_QUEUE_1357_1172515222_3_2isalreadyactive(45807)

ContactCustomerSupport.

ERROR

45808

Atransactionwasneverstartedorexpired.

Notransactionforclient:node.client.com_FINDEX_QUEUE_1357_1172515222_3_2(45808)

Nouserinterventionisrequired.Thesystemhandlesthisconditioninternally.

E 4 Invalid

IBMUnstructuredData751, p. 350

Page 360: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

RROR

5810

Programmingerror.volumeId.Expected:1357Received:2468(45810)

ContactCustomerSupport.

ERROR

45812

AFileI/Oerroroccurredwhilethesystemwasaccessingindexdata.

Failedtowritedisk(45812).

Tryyourqueryagain.ContactCustomerSupportformoreassistanceifnecessary.

ERROR

45814

Thequeryexpressionistoolong.

Query:'a*b*c*d*e*'istoocomplex(45814)

Refineyourfull-textquery.

ERROR

45815

Thefilethatisbeingindexedistoolargeorthequeryexpressionistoocomplex.Theenginetemporarilyranoutofmemory.

JavaheapexhaustedwhileindexingnodewithID:'10f4179cd5ff22f2a6b79a1bc3aef247fd94ccff'(45815)

Checktheskippedfilelistintheauditlogforfilesthatfailedtoloadduetotheirsizes.Reviseyourqueryexpressionandtryagain.

ERROR

46023

Tarcommandfailedwhileitpersistsfull-textdatatoWindowsShareorNFSshare.

Failedtobackupfull-textdataforserver:share.Reason:<reason>.(46023)

Checkdiskspaceandpermissions.

ERROR

46024

Unhandledunrecoverableexceptionwhilepersistingfull-textdataintoa.tgzfile.

Exception<exception>whilebackingupfulltextdataforserver:share(46024)

ContactCustomerSupport.

ERROR

46025

Wasnotabletodeletepartial.tgzfileafterafailedfull-textbackup.

Failedtounlinkincompletebackupimage.Reason:<reason>.(46025)

Checkpermissions.

ERROR

47002

Synchronizationfailedonaquery.

Synchronizationfailedforquery'<query-name>'onvolume'<server-and-volume>(47002)

ContactCustomerSupport.

E 4Anerroroccurredduring

Cannot

processfull-

IBMUnstructuredData751, p. 351

Page 361: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

RROR

7101

Anerroroccurredduringthequeryofafull-textexpression.

textexpression(Failedtoreadfromdisk(45812)(47101)

RestartservicesandcontactCustomerSupport.

ERROR

47203

Nomoredatabaseconnectionsareavailable.

Databaseconnectionsexhausted(512/511)(47203)

ContactCustomerSupport.

ERROR

47207

Userisrunningoutofdiskspace.

Diskusageexceedsthreshold.(%d)

ContactCustomerSupport.Inrarecases,thismessagecanindicateaprogramerrorleakingdiskspace.Inmostcases,however,diskspaceisalmostfull,andmorestorageisrequired.

ERROR

47212

Interrogatorfailedwhilethesystemprocessedafile.Thecurrentfileismissingfromthevolumecluster.

Harvester1Doesnotexist.Actiontaken:restart.(47212)

Iftheproblempersists(thatis,thesystemfailsonthesamefileortypeoffiles),contactCustomerSupport.

ERROR

47214

SNMPnotificationsenderisunabletoresolvethetraphostname.

Unabletoresolvehostnamenomachine.nowhere.com(47214)

CheckspellingandDNSsetup.

ERROR

50011

TheDDL/DMLfilesthatarerequiredforthedatabaseversioningwerenotfoundintheexpectedlocationonthedataserver.

DatabaseversioncontrolSQLfilenotfound.(50011)

ContactCustomerSupport.

ERROR

50018

Indicatesthatthepre-upgradedatabaserestorationfailed,whichwasattemptedasaresultofadatabaseupgradefailure.

Databaserestoreisunsuccessful.ContactCustomerSupport.(50018)

ContactCustomerSupport.

ERROR

50020

Indicatesthatthecurrentdatabaserequirementsdonotmeetthoserequirementsthatarespecifiedfortheupgradeandcannotproceedwiththeupgrade.

Versionsdonotmatch!Expectedcurrentdatabaseversion:<dbversion>.(50020)

ContactCustomerSupport.

ERROR

50021

Indicatesthatthefulldatabasebackupfailedwhenthesystemattemptsadata-objectleveldatabasebackup.

Databasebackupfailed.(50021)

ContactCustomerSupport.

ERROR

61003

Discoveryexportpolicyfailedtomountvolume.

Productionpolicyfailedtomountvolume.

Aborting.

IBMUnstructuredData751, p. 352

Page 362: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

(61003)

ERROR

61005

Thediscoveryexportloadfilegenerationfailsunexpectedly.Theloadfilescanbeproducedcorrectly,butpost-processingactionslikeupdatingaudittrailsandgeneratingreportfilesmightnotcomplete.

Productionloadfilegenerationfailed.Loadfilesmaybeproduced,butpost-processingmaybeincomplete.(61005)

ContactCustomerSupport.

ERROR

61006

Thediscoveryexportloadfilegenerationwasinterruptedbecausethetargetdiskisfull.

Productionloadfilegenerationinterrupted.Targetdiskfull.(61006)

Freeupspaceonthetargetdisk,voidthediscoveryexportrunandrunthepolicyagain.

ERROR

68001

Thegatewayanddataservermustbeonthesameversiontoconnect.

Gatewayconnectionfailedduetounsupporteddataserverversion.

Updateyourdataservertothesamebuildnumberasthegatewayandrestartservices.Ifyourencounterissues,contactCustomerSupport.

ERROR

68003

Thedataserverfailedtoconnecttothegatewayoveranextendedperiod.

Thedata-serverconnectiontothegatewaycannotbeestablished.

ContactCustomerSupport.

ERROR

8002

Thesystemfailedtoopenaconnectiontothedatabase.

Failedtoconnecttothedatabase(80002)

The"maximumdatabaseconnections"configurationparameterofthedatabaseenginemightneedtobeincreased.ContactCustomerSupport.

Parenttopic:Eventlogmessages

RelatedreferenceEventlogmessages

IBMUnstructuredData751, p. 353

Page 363: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

INFOeventlogmessagesThefollowingtablecontainsacompletelistingofallINFOevent-logmessages.

Table1.INFOeventlogmessages

Type Eventnumber Reason SamplemessageRequiredcustomeraction

INFO 9001Noconditionswereaddedtoaquery.

Harvester:Query<queryname>cannotbeinferredbecausenoconditionforithasbeendefined(9001).

Addconditionstothespecifiedquery.

INFO 9002Oneormoreconditionsinaquerywereincorrect.

Harvester:Query<queryname>cannotbeinferredbecauseofregularexpressionorotherconditionerror(9002).

Verifythatregularexpressionsareproperlyformed.

INFO 9003VolumeHarvestiscompleteandexplorersarebeingcalculated.

Volumestatisticscomputationstarted(9003).

Nouserinterventionisrequired.

INFO 9004Explorercalculationsarecomplete.

Volumestatisticscomputationcompleted(9004).

Nouserinterventionisrequired.

INFO 9005Querymembershipcalculationsstarted.

Queryinferencewillbedonein<number>steps(9005).

Nouserinterventionisrequired.

INFO 9006

Querymembershipcalculationsprogressinformation.

Queryinferencestep<number>done(9006).

Nouserinterventionisrequired.

INFO 9007Querymembershipcalculationscompleted.

Queryinferencecompleted(9007).

Nouserinterventionisrequired.

INFO 9012Indicatestheendofdumpingthecontentofthevolumecache.

DumpofVolumecache(s)completed

(9012).

Nouserinterventionis

required.

IBMUnstructuredData751, p. 354

Page 364: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

INFO 9013Indicatesthebeginningoftheloadprocess.

Postprocessingforvolume'CompanyDataServer:/mnt/demo-A'started(9013).

Nouserinterventionisrequired.

INFO 9067 Indicatesloadprogress.

Systemmetadataandtaggedvaluesweresuccessfullyloadedforvolume'server:volume'(9067).

Nouserinterventionisrequired.

INFO 9069 Indicatesloadprogress.

Volume'dataserver:/mnt/demo-A':Systemmetadata,taggedvaluesandfull-textindexweresuccessfullyloaded(9069).

Nouserinterventionisrequired.

INFO 9084 Thevolumeexportfinished.

Exportingvolume'dataserver:/mnt/demo-A'(1357)completed(9084)

Nouserinterventionisrequired.

INFO 9087 Thevolumeimportfinished.

Importingvolume'dataserver:/mnt/demo-A'(1357)completed(9087)

Nouserinterventionisrequired.

INFO 9091Theloadprocesswasendedbytheuser.

Loadabortedduetouserrequest(9091).

Nouserinterventionisrequired.

INFO 15008Thevolumeloadstepwasskipped,peruserrequest.

Postprocessingskippedforvolume<server>:<vo-lume>.(15008)

Nouserinterventionisrequired.

INFO 15009

Thevolumeloadstepwasrunbuttheharveststepwasskipped,peruserrequest.

Harvestskippedforvolume<server>:<vol-ume>.(15009)

Nouserinterventionisrequired.

INFO 15012

Thepolicythatranonthevolumeis

completeandthevolumeloadcannowproceed.

Volume<volume>onserver<server>is

freenow.Proceedingwithload.(15012)

Nouserinterventionisrequired.

IBMUnstructuredData751, p. 355

Page 365: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

nowproceed.

INFO 15013Theconfiguredtimelimitonaharvestwasreached.

Harvesttimelimitreachedforserver:share.Endingharvestnow.(15013)

Nouserinterventionisrequired.

INFO 15014Theconfiguredobjectcountlimitonaharvestwasreached.

Objectcountlimitreachedforserver:share.Endingharvestnow.(15014)

Nouserinterventionisrequired.

INFO 15017Checkboxisselectedfornightlyloadjob.

Deferringpostprocessingforvolumeserver:vol(15017)

Nouserinterventionisrequired.

INFO 15018Harvestsizeortimelimitisreached.

Harvestlimitreachedonserver:volume.Syntheticdeleteswillnotbecomputed.(15018)

Nouserinterventionisrequired.

INFO 15019 Userstopsharvestprocess.

Harveststoppedbyuserwhileprocessingvolumedpfsvr:vol1.Restofvolumeswillbeskipped.(15019)

Nouserinterventionisrequired.

INFO 15020

Theharvestvocabularychanged.Fullharvestmustruninsteadofincremental.

Vocabularyfordpfsvr:jhaide-Ahaschanged.Afullharvestisrecommended(15020).

Fullharvestmustberuninsteadofanincrementalharvest.

INFO 15022

TheuseristryingtorunanACL-onlyharvestonavolumethatisnotaWindowsShareorSharePointvolume.

Permission-onlyharvest:permissionchecksnotsupportedfor<server>:<share>

Noactionisneededasthevolumeisskipped.

INFO 15023

TheuseristryingtorunanACL-onlyharvestonavolumethatwasassignedauserlist.

Permission-onlyharvest:volume<server>:<share>hasnoassociateduserlist.

Noactionisneededasthevolumeisskipped.

SentwhenCenteraDiscoverysends

CenteraExternalIterator:Startingtopopulateusingpool

Nouser

IBMUnstructuredData751, p. 356

Page 366: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

INFO 17002 DiscoverysendsthequerytotheCenteraserver

populateusingpoolQAPOOL.(17002)

Nouserinterventionisrequired.

INFO 17003

SentwhenCenteraDiscoveryautocreatesanewvolume

<servername>:CreatednewvolumeQAPOOL:_QA-POOL_2009_JAN_1(17003)

Nouserinterventionisrequired.

INFO 17004

ACenteraDiscoveryauto-createdvolumereachedthepreconfiguredlimit,startinganewone.

Objectlimitreachedfor_QAPOOL_2009_JAN_1,startingnewvolume(17004)

Nouserinterventionisrequired.

INFO 17007PendingdatareturnfromCentera.

CenteraHarvester:NoitemsreturnedfromCenteraforover5minutes.Stillwaiting.(17007)

CheckwhetheraCenteranodeisdown.ACenteraclustermightbeoverloaded.

INFO 17009ConfiguredtimelimitisreachedforCenteradiscoverystep.

CenteraDiscovery:timelimitfordiscoveryreached.Endingthisrun.(17009)

Nouserinterventionisrequired.

INFO 17010

ConfiguredobjectcountlimitthatisreachedforCenteradiscoverystep.

CenteraDiscovery:configureditemcountlimitfordiscoveryreached.Endingthisrun.(17010)

Nouserinterventionisrequired.

INFO 17507

Limit(timeorobjectcount)reachedforgenericretentiondiscovery.

Retentiondiscoverylimitreachedfor<server>:<share>

ContactCustomerSupport.

INFO 17508

Genericretentiondiscoveryfoundnonewitemsforthismastervolume.

Nonewitemsdiscovered.Post-processingskippedforvolume<server>:<share>

Nouserinterventionisrequiredunlesstheuseriscertainthatnewitemsmustbediscovered.

INFO 17509Genericretentiondiscoverycreatedanewvolume.

Creatednewdiscoveredvolume<server>:<share>involumeset<autodis-

Nouserinterventionisrequired.

IBMUnstructuredData751, p. 357

Page 367: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

INFO 17509 anewvolume. volumeset<autodis-coveredvolumesetname>.

required.

INFO 18004 Jobwasstopped.Walker._processFile:GrazerStopped.(18004)

Nouserinterventionisrequired.

INFO 18005 Grazerqueuewasclosed.

Walker._processFile:GrazerClosed.(18005)

Nouserinterventionisrequired.

INFO 18016

Displaysthelistoftop-leveldirectoriesthatareselectedbymatchingthestartdirectoryregularexpression.Displaysatthebeginningofaharvest.

Choosingtop-leveldirectories:<directories>(18016)

Nouserinterventionisrequired.

INFO 34001Markscurrentprogressofacopyaction.

<volume>:<count>dataobjectsprocessedbycopyaction.(34001)

Nouserinterventionisrequired.

INFO 34004Markscurrentprogressofadeleteaction.

<volume>:<count>dataobjectsprocessedbydeleteaction.(34004)

Nouserinterventionisrequired.

INFO 34008Markscurrentprogressofamoveaction.

<volume>:<count>dataobjectsprocessedbymoveaction.(34008)

Nouserinterventionisrequired.

INFO 34014 Apolicyauditwasdeleted.

DeletingPolicyAudit#<auditid><policyname><starttime>(34014)

Nouserinterventionisrequired.

INFO 34015 Apolicyauditwasdeleted.

DeletedPolicyAudit#<auditid><policyname><starttime>(34015)

Nouserinterventionisrequired.

INFO 34031

Progressupdateofthediscoveryexportpolicy,every10000objectsprocessed.

Winserver:topshare:30000dataobjects

processedbyproductionaction.(34031)

Nouser

interventionisrequired.

IBMUnstructuredData751, p. 358

Page 368: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

processed. (34031)

INFO 41001Ajobwasstartedeithermanuallyorwasscheduled.

<jobname>started.(41001)

Nouserinterventionisrequired.

INFO 41002Theuserstoppedajobthatwasrunning.

<jobname>stoppedatuserrequest(41002)

Nouserinterventionisrequired.

INFO 41003Ajobiscompletednormallywithorwithoutsuccess.

<jobname>completed.(41003)

Nouserinterventionisrequired.

INFO 41006

Rebootingorrestartingservicesonthecontrollerorcomputenodecausesalljobstostop.

Serviceshutdown.Stoppingoutstandingjobs.(41006)

Rerunjobsafterrestartifyouwantthejobstocomplete.

INFO 41008

Databasecompactor(vacuum)jobcannotrunwhilethereisdatabaseactivity.

Databasecompactorwasnotrunbecauseotherjobsareactive(41008).

Setthedatabasecompactor'sjobschedulesothatitdoesnotconflictwithlong-runningjobs.

INFO 42005

Theactioncompletedorwasended.Showsresultsofcopyaction.

Copycomplete:<number>dataobjectscopied,<number>collisionsfound.(42005)

Nouserinterventionisrequired.

INFO 42010

Theactioncompletedorwasended.Showsresultsofmoveaction.

Movecomplete:<number>dataobjectsmoved,<number>collisionsfound.

(42010)

Nouserinterventionisrequired.

INFO 42018

Theactioncompletedorwasended.Showsresultsofdeletedaction.

Copydataobjectscomplete:<number>dataobjectscopied,<number>collisionsfound.(42018)

Nouserinterventionisrequired.

Third-partyapplication

CenteraDeletedFilesSynchronizercomplete:10000 Nouser

IBMUnstructuredData751, p. 359

Page 369: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

INFO 42020applicationdeletedclipsondiscoveredCenteravolumes.

complete:10000objectspassed.2objectsweremissingfromtheCenteracluster.(42020)

Nouserinterventionisrequired.

INFO 42024Thesynchronizerwascompletednormally.

ContentDataSynchronizercomplete.(42024)

Nouserinterventionisrequired.

INFO 42028

Theactioncompletedorwasended.Showsresultsofpolicyaction.

Policycompleted(42028).

Nouserinterventionisrequired.

INFO 42032

Theactioncompletedorwasended.Showsresultsofreportaction.

<reportname>completed(42032).

Nouserinterventionisrequired.

INFO 42033

ThesynchronizerstartedautomaticallyormanuallywiththeGUIbutton.

ContentDataSynchronizerstarted.(42033)

Nouserinterventionisrequired.

INFO 42048

Reportsthatthesynchronizerisskippingavolumeifsynchronizationisdeterminednottoberequired.

ContentDataSynchronizerskipping<server-name>:<volume-name>asitdoesnotneedsynchronization.42048)

Nouserinterventionisrequired.

INFO 42049

Reportsthatthesynchronizerstartedsynchronizationofavolume.

ContentDataSynchronizerstartingsynchronizationforvolume<server-name>:<volume-name>

Nouserinterventionisrequired.

INFO 42053

Thepolicythatwaswaitingforparticipantvolumestobeloadedbeforeitcontinues,isnowstarting.

Proceedingwithexecutionof<policy-name>.

Nouserinterventionisrequired.

Reportoncompletionofdiscoveryexport

ProductionRunonobjects(Copyingnativeobjects)

Nouser

IBMUnstructuredData751, p. 360

Page 370: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

INFO 42063 discoveryexportpolicyexecutionphase.

nativeobjects)completed:2003dataobjectscopied,25duplicatesfound.(42063)

interventionisrequired.

INFO 42065

Adiscoveryexportpolicythatwasheldupforwantofresources,isnowdonewaiting,andbeginsexecution.

Proceedingwithexecutionof'ProductioncaseOne'.(42065)

Nouserinterventionisrequired.

INFO 42066Anewdiscoveryexportrunstarted.

Newrunnumber10startedforproductionProductionCase23221.(42066)

Notethenewrunnumbertotiethecurrentrunwiththecorrespondingaudittrail.

INFO 42067

DiscoveryexportpolicyispreparingtheaudittrailinXMLformat.Itmighttakeafewminutes.

ProductionRunproducingAuditTrailXML.(42067)

Nouserinterventionisrequired.

INFO 42074

Aqueryortagwasreplicatedtoamemberdataserversuccessfully.

Successfullysentquery'Custodian:Joe'tomemberdataserverSanJoseOffice(42074)

Nouserinterventionisrequired.

INFO 46001

Thebackupprocessbegan.Anyselectedbackupsinthesystemconfigurationscreenarerunifnecessary.

BackupProcessStarted.(46001)

Nouserinterventionisrequired.

INFO 46002

Thebackupprocessdidnotcompleteallitstaskssuccessfully.Oneormorebackuptypesdidnotoccur.

BackupProcessFailed:<error-description>.(46002)

Checkyourbackupvolume.

Thebackupprocesscompleted

IBMUnstructuredData751, p. 361

Page 371: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

INFO 46003

completedattemptingallthenecessarytaskssuccessfully.Anypartsoftheoverallprocessaddtheirownlogentries.

BackupProcessFinished.(46003)

Nouserinterventionisrequired.

INFO 46004

TheApplicationDatabackup,aspartoftheoverallbackupprocess,neededtorunbutdidnotsucceed.

ApplicationDatabackupfailed.(46004)

Checkyourbackupvolume.LookatthesetupfortheApplicationDatabackup.Ifbackupscontinuetofail,contactCustomerSupport.

INFO 46005

TheApplicationDatabackup,aspartoftheoverallbackupprocess,neededtorunandsucceeded.

ApplicationDatabackupfinished.(46005)

Nouserinterventionisrequired.

INFO 46006

TheApplicationDatabackup,aspartoftheoverallbackupprocess,wasnotconfigured.

ApplicationDatabackupnotconfigured,skipped.(46006)

Nouserinterventionisrequired.

INFO 46007

TheHarvestedVolumeDatabackup,aspartoftheoverallbackupprocess,neededtorunbutdidnotsucceed.

HarvestedVolumeDatabackupfailed.(46007)

Checkyourbackupvolume.LookatthesetupfortheHarvestedVolumeDatabackup.Ifbackupscontinuetofail,contactCustomerSupport.

INFO 46008

TheHarvestedVolumeDatabackup,aspartoftheoverallbackupprocess,neededtorunandsucceeded.

HarvestedVolumeDatabackupfinished.(46008)

Nouserinterventionisrequired.

IBMUnstructuredData751, p. 362

Page 372: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

andsucceeded.

INFO 46009

TheHarvestedVolumeDatabackup,aspartoftheoverallbackupprocess,wasnotconfigured.

HarvestedVolumeDatabackupnotconfigured,skipped.(46009)

Nouserinterventionisrequired.

INFO 46010

TheSystemConfigurationbackup,aspartoftheoverallbackupprocess,neededtorunbutdidnotsucceed.

SystemConfigurationbackupfailed.(46010)

Checkyourbackupvolume.LookatthesetupfortheSystemConfigurationbackup.Ifbackupscontinuetofail,contactCustomerSupport.

INFO 46011

TheSystemConfigurationbackup,aspartoftheoverallbackupprocess,neededtorunandsucceeded.

SystemConfigurationbackupfinished.(46011)

Nouserinterventionisrequired.

INFO 46012

TheSystemConfigurationbackup,aspartoftheoverallbackupprocess,wasnotconfigured.

SystemConfigurationbackupnotconfigured,skipped.(46012)

Nouserinterventionisrequired.

INFO 46013

TheAuditTrailbackup,aspartoftheoverallbackupprocess,neededtorunbutdidnotsucceed.

PolicyAuditTrailbackupfailed.(46013)

Checkyourbackupvolume.LookatthesetupfortheAuditTrailbackup.Ifback-upscontinuetofail,contactIBMsupport.

INFO 46014

TheAuditTrailbackup,aspartoftheoverallbackupprocess,neededtorunandsucceeded.

PolicyAuditTrailbackupfinished.(46014)

Nouserinterventionisrequired.

TheAuditTrailIBMUnstructuredData751, p. 363

Page 373: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

INFO 46015

TheAuditTrailbackup,aspartoftheoverallbackupprocesswasnotconfigured.

PolicyAuditTrailbackupnotconfigured,skipped.(46015)

Nouserinterventionisrequired.

INFO 46019 Volumeclusterbackupfailed.

IndexedDatabackupfailed:<specificerror>(46019)

ContactCustomerSupport.

INFO 46020 Volumeclusterbackupfinished.

IndexedDatabackupfinished.(46020)

Nouserinterventionisrequired.

INFO 46021Volumeisnotconfiguredforindexeddatabackups.

IndexedDatabackupnotconfigured,skipped.(46021)

Nouserinterventionisrequired.

INFO 46022Full-textdatawassuccessfullybackedup.

Successfullybackedupfull-textdataforserver:share(46022)

Nouserinterventionisrequired.

INFO 47213Interrogatorwassuccessfullyrestarted.

Harvester1isnowrunning.(47213)

Nouserinterventionisrequired.

INFO 60001

Theuserupdatesanobjectonthesystem.Itincludesanyobjecttypeonthedataserver,includingtheupdatingofvolumes.

Querycitieswasupdatedbytheadministratoraccount(60001).

Nouserinterventionisrequired.

INFO 60002

Theusercreatesanobject.Itincludesanyobjecttypeonthedataserver,includingthecreationofvolumes.

Querycitieswascreatedbytheadministratoraccount(60002).

Nouserinterventionisrequired.

INFO 60003

Theuserdeletesanobject.Itincludesanyobjecttypeonthedataserver,

includingthedeletionofvolumes.

Querycitieswasdeletedbytheadministrator

account(60003).

Nouserinterventionisrequired.

IBMUnstructuredData751, p. 364

Page 374: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

volumes.

INFO 60004Theuserpublishesafull-textquerysetoraquery.

Querycitiesdraftwaspublishedbytheadministratoraccount(60004).

Nouserinterventionisrequired.

INFO 60005

Theusertagsanobject.Itincludesapublishedquery,adraftquery,ortag.

Querytaggingforcitiesclasswasstartedbytheadministratoraccount(60005).

Nouserinterventionisrequired.

INFO 60006Auserrestartedservicesonthedataserver.

Applicationservicesrestartforalldataserverswasrequestedbytheadministratoraccount(60006).

Nouserinterventionisrequired.

INFO 61001Concordancediscoveryexportisnowpreparingtheloadfiles.

Preparingforuploadofloadfile(s).(61001)

Nouserinterventionisrequired.

INFO 61002Concordancediscoveryexportisreadytouploadtheloadfiles.

Loadfile(s)readyforupload.(61002)

Nouserinterventionisrequired.

INFO 65000Thelogfilefinisheddownloading.

Logfiledownloadcomplete(65000)

Nouserinterventionisrequired.

Parenttopic:Eventlogmessages

RelatedreferenceEventlogmessages

IBMUnstructuredData751, p. 365

Page 375: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

WARNeventlogmessagesThefollowingtablecontainsacompletelistingofallWARNevent-logmessages,reasonsforoccurrence,samplemessages,andanyrequiredcustomeraction.

Table1.WARNeventlogmessages

Type

Eventnumber

Reason Samplemessage Customeraction

WARN

1002

AnInterrogatorprocessfailedbecauseofanunknownerror.Thedataobjectthatwasprocessingisskipped.Anewprocessiscreatedtoreplaceit.

Processingcouldnotbecompletedonobject,interrogatordied:<dataobjectname>.(1002)

ClassifythedocumentmanuallyandContactCustomerSupport.

WARN

1003

Interrogatorchildprocessdidnotproperlygetstarted.Theremightbeproblemstoaccessthevolumetobeharvested.

Interrogatorterminatedbeforeaccessingdataobjects.(1003)

Trytoreaddthevolumethatisharvested.Ifthatfails,contactCustomerSupport.

WARN

1004

Interrogatorchildprocesswasendedbecauseitwasnolongerresponding.Thedataobjectthatwasprocessingisskipped.Anewprocessiscreatedtoreplaceit.

Processingwasnotcompletedonobject,interrogatorkilled:<dataobjectname>.(1004)

ContactCustomerSupport.

WARN

6001

Auseremailmightnotbesent.Themailserversettingsareincorrect.

Failedtosendanemailtouser<emailaddress>;checkmailserverconfigurationsettings(6001).

VerifythatyourSMTPserverisconfiguredcorrectly.MakesurethattheIPaddressthatisconfiguredforthedataservercanrelayontheconfiguredSMTPserver.

WARN

8001

Thedatabaseneedstobevacuumed.

TheDatabaseisapproachinganoperationallimit.PleaseruntheDatabasemaintenancetaskusingtheConsoleinterface(8001)

Runthedatabasemaintenancetasktovacuumthedatabase.

WA

90 Taggedvalueswereloaded,butfull-

Systemmetadataandtaggedvalueswereloadedsuccessfullyfor ContactCustomer

IBMUnstructuredData751, p. 366

Page 376: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

RN

68

textindexloadingfailed. volume'server:volume',butloadingthefull-textindexfailed(9068)

Support.

WARN

9070

Taggedvaluesandfull-textindexloadingfailed.

Loadingsystemmetadata,taggedvaluesandthefull-textindexfailedforvolume'server:volume'(9070)

ContactCustomerSupport.

WARN

15003

Thevolumemountappearedtosucceed,butthetestformountfailed.

Volume<volumename>onserver<servername>isnotmounted.Skipping.(15003)

ContactCustomerSupport.

WARN

15004

Acomponentcleanupfailureonstoporcompletion.

[<component>]Cleanupfailureonstop.(15004)

ContactCustomerSupport.

WARN

15005

Therewasacomponentrunfailure. [<component>]Runfailure.(15005)

ContactCustomerSupport.

WARN

15006

Cleanupfailedforcomponentafterarunfailure.

[<component>]Cleanupfailureonabort.(15006)

ContactCustomerSupport.

WARN

15007

Acomponentthatistimedoutneedstobestopped.

Component[<component>]unresponsive;autostoppingtriggered.(15007)

Tryyouractionagain.Ifthiserrorcontinues,contactCustomerSupport.

WARN

15010

Thesamevolumecannotbeharvestedinparallel.Theharvestisskippedandthenextone,ifanyareinqueue,started.

Volume<volume-name>onserver<server-name>isalreadybeingharvested.Skipping.(15010)

Nouserinterventionisrequired.Youmightwanttoverifythatthevolumeharvestiscomplete.

WARN

15011

Avolumecannotbeharvestedifitisbeingusedbyanotherjob.Theharvestcontinueswhenthejobiscomplete.

Volume<volume-name>onserver<server-name>isbeingusedbyanotherjob.Waitingbeforeproceedingwithload.(15011)

Nouserinterventionisrequired.

IBMUnstructuredData751, p. 367

Page 377: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

WARN

15015

Configuredharvesttimelimitisreached.

Timelimitforharvestreached.SkippingVolumev1onservers1.1(15015)

Reconfigureharvesttimelimit.

WARN

15016

Configuredharvestobjectcountlimitisreached.

Objectcountlimitforharvestreached.SkippingVolumev1onservers1(15016)

Reconfigureharvestdataobjectlimit.

WARN

17008

QuerythatrantodiscoverCenteraitemsendedunexpectedly.

CenteraExternalIterator:CenteraQueryterminatedunexpectedly(<errordescription>).(17008)

ContactCustomerSupport.

WARN

17011

Runningdiscoveryonthesamepoolinparallelisnotallowed.

PoolJpoolappearstohaveanotherdiscoveryrunning.Skipping.(17011).

Makesurethattwojobsarenotrunningatthesametimethatdiscoversthesamepool.

WARN

17502

Genericretentiondiscoveryisalreadyrunningforthismastervolume.

Volume<server>:<share>appearstohaveanotherdiscoveryrunning.Skipping.

Nouserinterventionisrequiredasthenextstep,ifany,withinthejobisrun.

WARN

17504

SentwhenaretentiondiscoveryisrunonanyvolumeotherthanaWindowsShareretentionvolume.

Volume<server>:<share>isnotsupportedfordiscovery.Skipping.

ContactCustomerSupport.

WARN

18007

DirectorylistingorprocessingofdataobjectfailedinGrazer.

Walker._walktree:OSError-<path><rea-son>(18007)

Makesurethattheappliancestillhasappropriatepermissionstoavolume.Verifythatthereisnetworkconnectivitybetweentheapplianceandyourvolume.ContactCustomerSupport.

WARN

18008

Unknownerroroccurredwhileprocessingdataobjectorlistingdirectory.

Walker._walktree:Unknownexception-<path>.(18008)

ContactCustomerSupport.

1

IBMUnstructuredData751, p. 368

Page 378: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

WARN

8009

Grazertimedoutprocessinganobject.

Walker._processFile:GrazerTimedOut.(18009)

ContactCustomerSupport.

WARN

18010

Theskipdirsfileiseithernotpresentornotreadablebyroot.

Unabletoopenskipdirsfile:<filename>.Cannotskipdirectoriesasconfigured.(18010)

ContactCustomerSupport.

WARN

18011

Anerroroccurredreadingtheknownextensionslistfromthedatabase.

Grazer._run:couldn'treadextensions-<reason>.(18011)

ContactCustomerSupport.

WARN

18012

Anunknownerroroccurredreadingtheknownextensionslistfromthedatabase.

Grazer._run:couldn'treadextensions.(18012)

ContactCustomerSupport.

WARN

18015

NFSinitializationwarningthatNISisnotavailable.

NISMappingnotavailable.(18015)

Usernameandgroupnamesmightbeinaccurate.CheckthatyourNISserverisavailableandproperlyconfiguredinthedataserver.

WARN

18017

AfolderinanEnterpriseVaultcasethatisharvestedwasskippedbecauseofinsufficientpermissions.

SkippingFolder(ID=3)involumeevdiscaccel.company.com:CaseOneduetoinsufficientpermissions.CheckReviewpermissionsonthefolder.(18017)

Ifallfolderswereexpectedtobeharvestedinthevolume,verifythattheusernameusedtoaddtheVolumehasFolderReviewpermissiononallfolders.

WARN

18019

ThecheckpointthatissavedfromthelastharvestoftheNewsGatordatasourcefailedtoload.Insteadofconductinganincrementalharvest,afullharvestisrun.

UnabletoloadcheckpointforNewsGatorvolume.Afullharvestwillbeperformedinstead.(18019)

Ifthemessagerepeatsinsubsequentharvests,contactCustomerSupport.

WARN

18020

ThecheckpointnotedforthecurrentharvestoftheNewsGatordatasourcemightnotbesaved.Thenextincrementalharvestofthedatasourceisnotabletopickupfromthischeckpoint.

UnabletosavecheckpointforNewsGatorharvestofvolume.(18020)

Ifthemessagerepeatsinsubsequentharvests,contactCustomerSupport.

Serveradministrators

IBMUnstructuredData751, p. 369

Page 379: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

WARN

33016

Systemmightnotunmountthisvolume.

WindowsShareProtocolSessionteardownfailed.(33016)

canseethatconnectionsarelefthangingforapredefinedtime.Theseconnectionswilldropoffaftertheytimeout.Nouserinterventionrequired.

WARN

33017

Systemencounteredanerrorwhileittriestofigureoutwhatqueryusesthisvolume.

Anerroroccurredwhileretrievingthequeryinstancespointingtoavolume.(33017)

ContactCustomerSupport.

WARN

33021

TheteardownoperationoftheconnectiontoaIBMInformationArchivevolumefailed.SomeconnectionscanbeleftopenontheIBMInformationArchiveserveruntiltheyaretimedout.

IBMInformationArchivetear-downfailed.(33021)

None

WARN

33023

AconnectiontotheDiscoveryAcceleratormightnotbetorndowncompletely,andafewresourcesontheservermightbetiedupforashortwhile.

HTTPConnectiontear-downtoDiscoveryAcceleratorfailed.(33023)

None

WARN

33028

Thetear-downoperationoftheconnectiontoaFileNetvolumefailed.SomeconnectionscanbeleftopenontheFileNetserveruntiltheytimeout.

IBMFileNettear-downoperationfailed.(33028)

None

WARN

34003

Skippedacopydataobjectbecausediskfullerror.

Copyactionerror:-Targetdiskfull,skippingcopy:<sourcevolume>to<targetvolume>.(34003)

Verifythatthereisspaceavailableonyourpolicydestinationandtryagain.

WARN

34010

Skippedamovedataobjectbecausediskfullerror.

Moveactionerror:-Targetdiskfull,skippingcopy:<sourcevolume>to<targetvolume>.(34010)

Verifythatthereisspaceavailableonyourpolicydestination.Afterverifyingthatspaceisavailable,runanotherharvestbeforeyourunyourpolicy.Uponharvestcompletion,tryrunningthepolicyagain.

WAR

3402

Discoveryexportpolicydetectsthetargetdiskisfullandskipsproductionofanobject.

DiscoveryexportRunactionerror:Targetdiskfull,skippingdiscoveryexport:share-1/saved/years.pdftoproduction/10/documents/1

Createsufficientspaceontargetdiskandrundiscoveryexportpolicy

IBMUnstructuredData751, p. 370

Page 380: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

N 9 /0x0866e5d6c898d9ffdbea720b090a6f46d3058605.txt.(34029)

again.

WARN

34032

Thepolicythatwasrunhasnovolumesinscopethatisbasedontheconfiguredqueryandscoping.Thepolicycannotberun.

Novolumesinscopeforpolicy.Skippingpolicyexecution.(34032)

Checkpolicyqueryandscopingconfiguration,andre-executepolicy.

WARN

34033

Celerradatamovererror.Therearemanypossiblecauses;theactualoneislistedintheerrormessage.Thesampleprovidesthemostcommonone.

DatamoverreturnedNO_MATCHING_CONNECTION:ThespecifiedOFFLINE_PATHwasnotabletomaptoanexistingconnectiontoasecondaryserver.(34033)

ConsulttheCelerraAdministratorManual.

WARN

34035

Iftheglobalhashsettingforthesystemissettonotcomputedataobjecthash,nohashcanbecomputedforthetargetobjectsduringapolicyaction.

Copyobjects:TargethashwillnotbecomputedbecauseHashingisdisabledforsystem.(34035)

Iftargethashesneedtobecomputedforthepolicyaudittrail,turnontheglobalhashsettingbeforeyourunthepolicy.

WARN

34036

Thepolicyhasnosourcevolumesinscope,whichmeansthatthepolicycannotberun.

Thepolicyhasnosourcevolume(s)inscope.Waitforthequerytoupdatebeforeexecutingthepolicy.(34036)

Confirmthatthequeryusedbythepolicyhasoneormorevolumesinscope.

WARN

42003

Thejobinthisactionisstoppedbytheuser.

Copydataobjectsstoppedatuserrequest.(42003)

Nouserinterventionisrequired.

WARN

42008

Thejobinthisactionisstoppedbytheuser.

Movedataobjectsstoppedatuserrequest.(42008)

Nouserinterventionisrequired.

WARN

42016

Thejobinthisactionisstoppedbytheuser.

Deletedataobjectsstoppedatuserrequest.(42016)

Nouserinterventionisrequired.

WA

420 Thejobinthisactionisstoppedby Policystoppedatuser Nouserinterventionis

IBMUnstructuredData751, p. 371

Page 381: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

RN

26

theuser. request.(42026) required.

WARN

42035

Whenthejobinthisactionisstoppedbytheuser.

Setsecurityfordataobjectsstoppedatuserrequest.(42035)

Nouserinterventionisrequired.

WARN

42051

Twoinstancesofthesamepolicycannotrunatthesametime.

Policy<policy-name>isalreadyrunning.Skipping.(42051)

Nouserinterventionisrequired.

WARN

42052

Policiescannotberununtilaftervolumesareloaded,ifthosevolumesareparticipantstothepolicybyvirtueofbeinginthequery.

Oneormorevolume(s)neededbypolicy<policy-name>arebeingloaded.Waitingforthebulkload(s)tofinish.(42052)

Nouserinterventionisrequired.

WARN

42061

Discoveryexportpolicywasstoppedbyuser.

Discoveryexportrunonobjects(Copyingnativeobjects)stoppedatuserrequest.(42061)

Nouserinterventionisrequired.

WARN

42064

Discoveryexportpolicyexecutionisdelayedbecauseaconflictingdiscoveryexportrunisinprogress.

ADiscoveryexportrunrelatedtopolicy'DiscoveryexportcaseOne'isinprogress.Waitingforittofinish.(42064)

Thediscoveryexportpolicyexecutionisheldupforrequiredresources.Executionmustbeginassoonasresourcebecomesavailable.

WARN

42068

Policyfailedtosetappropriatepermissionsonthetargetdirectory.Objectsthatarecreatedfromthepolicymightnothaveappropriatepermissionsset.

Copyobjectswarning,unabletosetpermissionsontargetdirectory:share-1/saved.(42068)

Policymightnotbeabletosetappropriatepermissionsontheobjectsitcreates.Ifitisnotacceptable,verifythattargetvolumehasappropriatewritepermissionsandre-execute.

WARN

42069

Ifthe“Copydataobjectsmodifiedsincelastharvest”optionisselectedforadiscoveryexportpolicy,itisvalidonlyifthediscoveryexportitselfisdefinedtoactontheoriginalfile/emailarchive,asopposedtotheirmembers.Ifitisnottrue,thewarningtellstheuserthatmodified

DiscoveryexportDAT_Exportisconfiguredtoactonmembersofcontainers,andcannotactonobjectsmodifiedafterthelastharvest.DiscoveryexportrunX

Ifthemodifiedobjectsneedtobeactedupon,eitheruseadiscoveryexportactiononlyontheoriginalfile/emailarchive,orconductanincrementalharveston

IBMUnstructuredData751, p. 372

Page 382: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

objectsareskipped. willskipmodifiedobjects.(42069)

thesourcevolumes.

WARN

46026

Volumeisbeingharvestedorpoliciesarerunningagainstit.Ifthereareotherfull-textindexestobebackedup,thesystemworksonthoseactions.Trythisvolumeagain.

Volumevolume:shareisinuse.Unabletobackupfull-textindex.Willretrylater.(46026)

Rerunbackupwhenvolumeisnotinuse.

WARN

47201

Databaseconnectionsaredowntoanormallevel.

Databaseconnectionsatnormallevelagain(512/100)(47201)

Nouserinterventionisrequired.

WARN

47202

Thesystemisstartingtorunlowondatabaseconnections.Thissituationisabnormal.Anindicationofprocessrestartsandconnectionsarenotbeingcleared.

Databaseconnectionsusageseemsexcessive(512/415)(47202)

ContactCustomerSupport.

WARN

47215

Someoneinternallyorexternallyistrying(andfailing)toSSHintothedataserver.

SSHD:Failedpasswordforrootfrom172.17.18.185port57982.(47125)

ContactyourlocalITmanager.Itmightbeeitheramistypedpasswordbyalegitimateuserorintheworstcasescenario,agenuinebreak-inattempt.

WARN

61003

Oneoftheloadfilescannotbeuploadedbecausethecomputenodemightnotbeaccessedtoobtain.

Failedtomounttransactioncachedump'/deepfs/postgres/pro-duction_cache'.(61003)

Someoftheloadfileswillbemissingafterthediscoveryexportcompletes.Theseloadfilesarereproducedonanewrun.Ifproblempersistsacrossruns,ContactCustomerSupport.

WARN

61004

Warnstheuserthatoneofthetransactioncachememorydumpprocessesencounteredanerror.Ifadiscoveryexportruns,itmeansthatthediscoveryexportfailstoproduceoneoftheloadfiles.

Note:Ifmultiplememorydumpsfail,thereisonewarningperfailedmemorydump.

TransactionCacheDumpfailedwitherror-Validationfailedduringcreationofloadfile.(61004)

Runthediscoveryexportpolicythatsawtheerroragain.Iftheerrorpersists,andyoucannotfindanycluster/dataserverconfigurationissues,contactCustomerSupport.

Parenttopic:Eventlogmessages

Relatedreference

IBMUnstructuredData751, p. 373

Page 383: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Eventlogmessages

IBMUnstructuredData751, p. 374

Page 384: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ManagingtheIBMStoredIQproductsIBM®StoredIQprovideinterfacesandtoolstomanagedatainyoursystem.Thefollowingtopicsdescribeindetailhowtousetheseinterfacesandtoolstoachieveyoursystemgoals.

ManagingIBMStoredIQDataScriptIBMStoredIQDataScriptprovidesaninterfacethatyoucanmanagedatafromtheDocumentDashboard.ThefollowingtopicsdescribeindetailhowtoworkwiththedocumentsinIBMStoredIQDataScript.ManagingIBMStoredIQDataWorkbenchIBMStoredIQDataWorkbenchisadatamanagementtoolthathelpsyoulearnaboutdatainyoursystemandmanageitforyourbusinesspurposes.ManagingIBMStoredIQeDiscoveryIBMStoredIQeDiscoverycapturesandmanagestheelectronicdatainyoursystem.IBMStoredIQeDiscoveryuses"matter"tocreateandorganizeinformationsothatyoucanalwayseasilyaccessthedatathatyouneedandreviewthestatusorprocessofyourwork.ManagingIBMStoredIQPolicyManagerIBMStoredIQPolicyManagerprovidesaninterfaceforyoutoviewavailablepolicies,create,edit,delete,orrunapolicyorareport.

IBMUnstructuredData751, p. 375

Page 385: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ManagingIBMStoredIQDataScriptIBM®StoredIQDataScriptprovidesaninterfacethatyoucanmanagedatafromtheDocumentDashboard.ThefollowingtopicsdescribeindetailhowtoworkwiththedocumentsinIBMStoredIQDataScript.

OverviewofIBMStoredIQDataScriptIBMStoredIQDataScriptenablesautomatedexecutionwithinIBMStoredIQPlatform.Youcanscript,automate,andmonitorprocessesthatarenormallyrunmanuallywithinIBMStoredIQDataWorkbench.IBMStoredIQDataScriptfocusesonrepeatable,understood,andapprovedprocessesforthepurposesofcullingandrefiningdatainanapprovedmanner.

Parenttopic:ManagingtheIBMStoredIQproducts

IBMUnstructuredData751, p. 376

Page 386: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

OverviewofIBMStoredIQDataScriptIBM®StoredIQDataScriptenablesautomatedexecutionwithinIBMStoredIQPlatform.Youcanscript,automate,andmonitorprocessesthatarenormallyrunmanuallywithinIBMStoredIQDataWorkbench.IBMStoredIQDataScriptfocusesonrepeatable,understood,andapprovedprocessesforthepurposesofcullingandrefiningdatainanapprovedmanner.

ThroughtheIBMStoredIQDataScriptinterface,youcanmonitoreachofthedatamanagementstepsastheyarerun.Youcanthenviewanydefinedoutputs,suchasreports,infosets,orexportsthataregeneratedasaresult.

Youcanchoosepredefinedworkflowsthatrunawell-definedsetofsteps.ThesestepsmimicaprocessthatauserusuallyrunsmanuallywithinIBMStoredIQDataWorkbench.Thesedefinedsteps,orworkflowsinIBMStoredIQDataScript,aremeanttoaddressrepeatableprocessesfordatamanagement.Byrunningworkflows,theusercanreapplyprocessesthathavebeenreviewedandapprovedtoapplytoawidevarietyofdifferentdataproblems.

WorkflowsoriginateinIBMStoredIQDataWorkbench,byselectingDetails>InfosetAncestry,orfromcustomscripts.InfosetscanbesavedasworkflowsinthedocumentsofIBMStoredIQDataScript,thestartingandendpointsforwhicharethefirstandlastoperationsintheinfosetancestry.

DocumentdashboardviewTheDocumentDashboardprovideshigh-leveloverviewsofexistingdocumentsandtheirstatuswithinIBMStoredIQDataScript.WorkfloworiginationWorkflowsoriginateinIBMStoredIQDataWorkbenchbyselectingDetails>InfosetAncestry,orfromcustomscripts.AddingadocumentTomanagedatawithIBMStoredIQDataScript,youmustfirstaddadocumenttomakeitavailablewithinIBMStoredIQDataScript.SearchingforadocumentYoucansearchexistingdocumentsfromtheDocumentDashboardof.ViewingadocumentAfteryouaddeddocumentsinIBMDataScript,youcanviewthemfromtheDocumentDashboard.DocumentdetailsTheIBMDataScriptinterfaceprovidestheDocumentDetailpageandtheWorkflowStatusandOutputspage,whichpresentsdetailedinformationaboutdocumentsandworkflowstatus.RunningaworkflowYoucanrunworkflowsonexistingdocumentstomodifyyourdocumentsasneeded.

Parenttopic:ManagingIBMStoredIQDataScript

IBMUnstructuredData751, p. 377

Page 387: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DocumentdashboardviewTheDocumentDashboardprovideshigh-leveloverviewsofexistingdocumentsandtheirstatuswithinIBM®StoredIQDataScript.

TheDocumentDashboardprovidesthreecriticalpiecesofinformationforeachaddeddocument:thedocument'sname,abriefdescriptionofthatdocument,andthedateandtimewhenthedocumentwascreated.FromtheDocumentDashboard,youcandothefollowingtasks:

AddadocumentbyclickingtheAddDocumentbutton.Viewadocumentbydouble-clickingthedocumentthatyouwanttosee.Searchforadocumentbyfilteringtheexistingdocuments.

RelatedconceptsDocumentdetails

RelatedtasksAddingadocumentSearchingforadocumentViewingadocument

IBMUnstructuredData751, p. 378

Page 388: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

WorkfloworiginationWorkflowsoriginateinIBM®StoredIQDataWorkbenchbyselectingDetails>InfosetAncestry,orfromcustomscripts.

InfosetscanbesavedasworkflowsandusedinIBMStoredIQDataScriptdocuments.Theyserveasthefirstandlastoperationsintheinfosetancestry.

RelatedtasksRunningaworkflow

IBMUnstructuredData751, p. 379

Page 389: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

AddingadocumentTomanagedatawithIBM®StoredIQDataScript,youmustfirstaddadocumenttomakeitavailablewithinIBMStoredIQDataScript.

Procedure1. FromtheDocumentDashboard,clickAddDocument.TheCreateDocumentdialogbox

appears.TheCreateDocumentdialogboxhasthreesteps:NameandDescription,Workflows,andInfosets.

2. WithintheNameandDescriptionsubtab,completethesefields.a. IntheNametextbox,enterauniquenameforthisdocument.b. Optional:IntheDescriptiontextbox,enterabriefdescriptionofthisdocument.c. ClickNexttoaccesstheWorkflowssubtab.

3. WithintheWorkflowssubtab,completethesefields.a. UseAddandRemovetoapplytheworkflowstobeavailableforthisdocument.b. Ifneeded,searchforanavailableworkflowintheEnterterms...textboxand

Search.c. ClickNexttoaccesstheInfosetssubtab.

4. WithintheInfosetssubtab,completethesefields.a. Selecttheinfosetnametochoosethestartinginfosetforthisdocument.b. Ifneeded,searchforanavailableinfosetintheEnterterms...textboxandSearch.c. ClickSavetocompletetheprocess.

TheaddeddocumentappearsintheDocumentDashboard.

RelatedconceptsDocumentdashboardview

IBMUnstructuredData751, p. 380

Page 390: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

SearchingforadocumentYoucansearchexistingdocumentsfromtheDocumentDashboardof.

Procedure1. ViewtheDocumentDashboardfromIBM®DataScript.2. IntheEntertermshere....textbox,enterthenameofthedocumentforwhichyouwant

tosearch,andthenpressSearch.Youcanentereitherthefulldocumentnameoraportionofitsname.Documentsthatmatchtheenteredsearchtermarereturned.

3. Toremovethesearchterm,clicktheXtotheleftoftheEntertermshere....textbox.

RelatedconceptsDocumentdashboardview

IBMUnstructuredData751, p. 381

Page 391: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ViewingadocumentAfteryouaddeddocumentsinIBM®DataScript,youcanviewthemfromtheDocumentDashboard.

ProcedureFromtheDocumentDashboard,double-clickthedocumentthatyouwanttoview.ThedocumentopenswithintheDocumentDetailspage.

RelatedconceptsDocumentdashboardview

IBMUnstructuredData751, p. 382

Page 392: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DocumentdetailsTheIBM®DataScriptinterfaceprovidestheDocumentDetailpageandtheWorkflowStatusandOutputspage,whichpresentsdetailedinformationaboutdocumentsandworkflowstatus.

DocumentdetailsTheDocumentDetailpagecontainsfivedistinctareas:

DocumentDashboardWorkflowsInfosetsActionsReports

FouriconsareusedtoindicatestatuswithintheDocumentDetailpage:Success,Fail,Processing,andProcessingNotYetStarted.

Success:Thisiconindicatesthatprocessingisfinishedandthattheworkflowsarecomplete.Fail:Thisiconindicatesthattheworkflow'sprocessingfailed.Processing:Thisiconindicatesthattheworkflowisstillprocessing.ProcessingNotYetStarted:Thisiconindicatesthattheworkflow'sprocessingisnotyetstarted.

TheDocumentDashboardprovidesanabbreviatedviewoftheselecteddocument,includingthedocument'sname,itscreationdateandtime,andabriefdescription.Itprovidestheoptiontoeditthedocument.

WorkflowStatusandOutputsWorkflowsdemonstratetheindividualbusinessprocessesofalargerprocedure:collectdata,collectcustodians,runactions,generateareport,movetopreservation,andexport.Thesequenceofworkflowscanbereorderedasneededtocreatedifferentworkflows,whichthenresultindifferentoutputs.

UserinfosetsthatarebasedontheirancestrycanbecreatedasworkflowswithinIBMDataScript.

IfnoworkflowsappearintheWorkflowDetailsarea,youcanaddaworkflowtoadocumentbyclickingAddWorkflow.

TheWorkflowDetailsincludesthesefields.

Name:Nameoftheworkflowthatwasprovidedwhentheworkflowwasadded.Description:Descriptionoftheworkflowthatwasprovidedwhentheworkflowwasadded.Started:Dateandtimewhentheworkflowbeganprocessingthedocument.OverallStatus:Informationabouttheworkflow'sstatus,includingwhichstepsarestillinprogressandwhichstepsarecompleted.

Thestatusiconsareusedtoprovideat-a-glanceviewsoftheworkflow'sstatus.Infosets,actions,andreportsarealloutputsofaworkflow;theartifactsarecreatedastheresultoftheworkflow'sexecution.

Infosets:Provideshigh-levelinformationaboutinfosetsandtheirstatus.Actions:Provideshigh-levelinformationaboutactionsandtheircompletionstatus.Reports:provideshigh-levelinformationaboutreportsandthestatusofreportgeneration.

IBMUnstructuredData751, p. 383

Page 393: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

RelatedconceptsDocumentdashboardview

IBMUnstructuredData751, p. 384

Page 394: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

RunningaworkflowYoucanrunworkflowsonexistingdocumentstomodifyyourdocumentsasneeded.

Procedure1. FromtheWorkflowStatusandOutputspage,clickRunWorkflow.TheRunWorkflow

dialogboxappears.2. SelectaworkflowandclickNext.3. IntheRunWorkflowdialogbox,completethesefields.

EntertheBaseNameofthisworkflowintheBaseNamefield.EnterabriefdescriptionofthisworkflowintheBaseDescriptionfield.Entertheemailaddresstowhichnotificationoftheworkflowresultissent.

4. ClickNext.5. IntheStartingInfosetwindow,selectthebuttonofthestartinginfosetforthisworkflow

andthenclickRun.Whentheworkflowrunssuccessfully,agreencheckmarkstheprocesscomplete.Otherwise,aredXmarkstheprocessasfailed.

RelatedconceptsWorkfloworigination

IBMUnstructuredData751, p. 385

Page 395: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ManagingIBMStoredIQDataWorkbenchIBM®StoredIQDataWorkbenchisadatamanagementtoolthathelpsyoulearnaboutdatainyoursystemandmanageitforyourbusinesspurposes.

OverviewofIBMStoredIQDataWorkbenchIBMStoredIQDataWorkbenchisadatavisualizationandmanagementtoolthathelpsyouactivelymanageyourcompany'sdata.InfosetmanagementTheinfosetwindowprovidesthefollowinghigh-levelinformationforaselectedinfoset.FilteradministrationFiltersareobjectsthatcanbeappliedtoinfosets.Youcanapplyonefilterwithmultiplefilterattributestoaninfoset,continuallyrefiningthatinfosetuntilitrepresentsresponsivedatathatyouneed.EnhancementstoinfosetTheEnhancetabprovidesyouwithavisuallayoutofavailableenhancements.EnhancementsarecreatedasmodelswithinIBMStoredIQAdministrator.Whenanenhancementisappliedtoaninfoset,itupdatesthatinfoset'sindex.ActionsondataActionsarepreconfiguredoptionsthathelpyoutomanagedataobjectsthatarecontainedwithininfosets.ExplorationofinfosetsanddataTheExploretabprovidesyouwithavisuallayoutofaninfoset.Ataglance,youcanseehowmuchdatayouhave,itstype,itsoverlays,anddetailedinformationaboutspecificdata.Byclickingwithinthedatamapitself,youcanexplorethedataandanalyzevariousdetails.ExceptionsExceptionlistscontainvariousdataobjectssuchasfiles,emails,whichencounteredanerrorwhenanactionwasconductedontheinfoset.Thislisthelpsyoutoknowexactlywhatdataneedsattentionduetosomeerrororexception.Italsoservesasaninformationaltraceofwhatwentwrongduringtheprocess.FilterconditionreferenceandexpressionlanguageThisappendixprovidesin-depthinformationaboutfull-textandattributeconditionsandhowtousetheexpressionlanguage.IBMDiscoveryExportEDRMXMLIBMEDRMXMLisbasedonthespecificationthatisdescribedintheEDRMXMLInterchangeFormatSchemaDocumentation,January23,2008.TheappendixdescribesthediscoveryexportfeatureforEDRMXML.MetadatabyattributetypeThisreferenceguidedescribesmetadatathatisorganizedbyattributetype.

Parenttopic:ManagingtheIBMStoredIQproducts

IBMUnstructuredData751, p. 386

Page 396: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

OverviewofIBMStoredIQDataWorkbenchIBM®StoredIQDataWorkbenchisadatavisualizationandmanagementtoolthathelpsyouactivelymanageyourcompany'sdata.

IBMStoredIQDataWorkbenchhelpsyoufindouthowmuchdatayouhave,whereitis,whoownsit,andwhenitwaslastused.Whenyouhaveaclearunderstandingofyourcompany'sdatalandscape,IBMStoredIQDataWorkbenchhelpsyoutakecontrolofitandmakeinformeddecisionsaboutyourdataandactonthatknowledge.

Bigdataisapervasiveproblemforthebusiness.IBMStoredIQDataWorkbenchisdevelopedtohelpyoulearnaboutyourdata,makeeducateddecisionsaboutthatdata,andturnadangerousriskintoavaluableasset.

IBMStoredIQDataWorkbenchcanbeusedinthefollowingways:

Findallemailsfromaspecificsenderinanytimeframethatyouspecify.Identifyunuseddatathatstaysinthesystemforalongtime.Searchforspecificformatoffilesonthenetworkforadefinedtimeperiod.Forexample,searchimagefilesthatwerecreatedin2007,andseehowmuchspacethesefilestakeonthenetwork.Provideavisualoverviewofhowdataisretained.Breakdownthedatasourcesothatforbiddeninformationsuchascredit-cardnumbersorSocialSecuritynumberscanbeidentified.

KeyconceptsofIBMStoredIQDataWorkbenchKeyconceptsofIBMStoredIQDataWorkbench,suchasinfosets,filters,refinements,andindexesareexplained.TheseconceptsarekeytounderstandingIBMStoredIQDataWorkbenchasawhole.

IBMUnstructuredData751, p. 387

Page 397: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

KeyconceptsofIBMStoredIQDataWorkbenchKeyconceptsofIBM®StoredIQDataWorkbench,suchasinfosets,filters,refinements,andindexesareexplained.TheseconceptsarekeytounderstandingIBMStoredIQDataWorkbenchasawhole.

InformationsetAninformationset,commonlyreferredtoasaninfoset,isasnapshotofdataatacertainpointintime.Aninfosetisconsistedofoneormanyindexes.Thedatathatiscontainedwithineachindexispresentedwithinasingleuserinterfaceonwhichausercanactorconductextrarefinements.Infosetsallowuserstoavoidthedetailsofwherethedataisfoundandfocusonwhatmatters:thedataitself.IBMStoredIQPlatformindexInfosetsarederivedfromtheIBMStoredIQPlatformindexofyourdatasources.Therefore,totakeadvantageofinfosets,theadministratormustfirstuseIBMStoredIQPlatformtoindexthedatasources.Contactyouradministratorformoreinformation.FilterFiltersareamixofuser-createdandsystem-providedobjectsthatcanbeappliedtoinfosets.Youcanapplyseveralfilterattributestoaninfoset,continuallyrefiningituntiltheinfosetrepresentstheexactamountofdatathatyouneed.OverlayOverlaysareconfigurablefiltersthatdisplayhitsormatchesinaselectedinfoset.ScopeoperationContaineddata,suchasdatawithin.ZIP,.TAR,or.PSTfiles,ishierarchicalandcanhavemanydifferentrelationshipandconnections.Dependingonhowthatdataisviewed,thatdatacangiveadifferentperceptionthanwhatisrepresented.TheScopeOperationstabhelpsuserstounderstandmorefullywhatdataisrepresentedbydatasets.ActionAnactionisanactivitythatiscreatedbyanadministratorandconductedonaninfoset.AvailableIBMStoredIQDataWorkbenchactionsincludecopy,copytoretention,delete,discoveryexport,modifyattribute,move,andsnippetstep-up.ReportIBMStoredIQDataWorkbenchreportingfunctionprovidesexternalviewsofinfosetsandvalidatesIBMStoredIQprocesses.ReportscanalsobecustomizedwiththeBIRTReportDesigner.

Parenttopic:OverviewofIBMStoredIQDataWorkbench

RelatedconceptsOverviewofIBMStoredIQDataWorkbench

IBMUnstructuredData751, p. 388

Page 398: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

InformationsetAninformationset,commonlyreferredtoasaninfoset,isasnapshotofdataatacertainpointintime.Aninfosetisconsistedofoneormanyindexes.Thedatathatiscontainedwithineachindexispresentedwithinasingleuserinterfaceonwhichausercanactorconductextrarefinements.Infosetsallowuserstoavoidthedetailsofwherethedataisfoundandfocusonwhatmatters:thedataitself.

InfosetBasicsAninfosetisanamed,persistentobjectthatanyusercanrefertobyreferencingitsname.Considerthesebasicinfosetconcepts:

InfosetsarederivedfromdatasourcesthatareindexedbyIBM®StoredIQPlatform.Infosetsareareferencetotheindexeddataatthetimethattheinfosetwascreated.Becauseaninfosetiscomposedofthatindexeddata,itismorerightlyviewedasasnapshotintime.Afteraninfosetisselected,alistofdataobjectscanthenbeviewed.Infosetscanbereferredtowhenyouareconductingactionssuchascopyingdata.

Table1.FrequentlyaskedquestionsaboutinfosetsQuestion Answer

Caninfosetsbedeleted?Yes.User-createdinfosetsandadministrator-createdsysteminfosetscanbedeleted;however,theAllDataObjectsandAllSystem-LevelObjectssysteminfosetscannotbedeleted.

AreIBMindexesreal-timeindexes?

No.Indexesarenotreal-timeindexes.Theyarerepresentativeofdataonlyatthetimeitwasharvested.

Cananinfosethavemorethanonefilterappliedtoit?

Filterscanbemadeupofmultipleattributes;however,onlyonefiltercanbeappliedtoaninfosetatatime.Keepinmindthataftereveryapplicationofafilter,anewinfosetiscreated.

TypesofinfosetsTherearetwotypesofinfosetswithinIBMStoredIQDataWorkbench:systemanduser.

Table2.IBMStoredIQDataWorkbenchInfosetTypesInformationSetType Description

System

AsysteminformationsetisaninfosetthatisgeneratedandkeptcurrentbyIBMStoredIQPlatform.Allobjectswithinthatsystemarekeptuptodatewiththeircurrentindex.Systeminfosetsarethestartingpointforuserinformationsets.

TheAllDataObjectsandAllSystem-LevelObjectsinfosetsareautomaticallygeneratedbyIBMStoredIQPlatform.EachtimeIBMStoredIQPlatformindexesadatasource,systeminfosetsareregenerated.CannotbeeditedbyusersandcanbeviewedbytheadministratorintheIBMStoredIQDataWorkbenchuserinterfaceTheAllDataObjectsandAllSystem-LevelObjectssysteminfosetsprovideuserswithastartingpointuponwhichtobaseallotherrefinements.AdministratorscancreatesysteminfosetsthattargetcertainvolumesintheIBMStoredIQAdministratorapplication.Thesesysteminfosetscanbeeditedanddeleted.

Thisinfosetisgeneratedbyauser,whichiscalledauserinfoset,andIBMUnstructuredData751, p. 389

Page 399: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

UserThisinfosetisgeneratedbyauser,whichiscalledauserinfoset,andisasnapshotintimeoftheunderlyingobjects.Theobjectsthatarerepresentedbytheuserinfosetmightchange,buttheinfosetitselfdoesnotchange.

Infosetsarederivedfromanynumberofindexeddatasources.Theyarealsoderivedthroughtheapplicationoffilters,whichresultsinarefinedinfoset.

Parenttopic:KeyconceptsofIBMStoredIQDataWorkbench

RelatedconceptsKeyconceptsofIBMStoredIQDataWorkbench

IBMUnstructuredData751, p. 390

Page 400: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

IBMStoredIQPlatformindexInfosetsarederivedfromtheIBM®StoredIQPlatformindexofyourdatasources.Therefore,totakeadvantageofinfosets,theadministratormustfirstuseIBMStoredIQPlatformtoindexthedatasources.Contactyouradministratorformoreinformation.

IBMStoredIQPlatformindextypesIndexingorharvestingistheprocessortaskbywhichIBMStoredIQPlatformexaminesandclassifiesdatainyournetwork.TheresultofthisindexingprocessisyourIBMStoredIQPlatformindex,whichisthebasisforyourworkinIBMStoredIQDataWorkbench.TheseindexesaregeneratedbytheIBMStoredIQdataserver,andeachdataserverisconfiguredtoindexdataatspecificnetworklocations.IndividualdataserversareresponsiblefordifferentsectionsofdatathatmightbecontainedondifferentdatasourcessuchasWindows,Exchange,Sharepoint,Documentum,Domino,orCentera.Thisdatacanbeatdifferentnetworkaddressesorevendifferentphysicallocations.

Note:Theadministratorconfiguresanddefinestheindextype.Ifyouhavequestionsaboutvolumetypes,datasources,orharvests,contactyouradministrator.

Table1.IBMStoredIQPlatformindextypesIBMStoredIQ

PlatformIndexType Description

MetadataIndexIBMStoredIQPlatformindexescontainalltheinformationaboutthedataataspecificlocationonanetwork,includingdescriptiveinformationorattributesaboutthedatasuchasfilename,filesize,createddate,andowner.

Full-TextIndexIBMStoredIQPlatformcanalsogenerateamoredetailedindexonthecontentsofthedataitself.Byreadingthecontentsofthedata,thewordsorcharactersthatarecontainedwithinthedatacanbereferredtoandsearchedagainst.

Parenttopic:KeyconceptsofIBMStoredIQDataWorkbench

RelatedconceptsKeyconceptsofIBMStoredIQDataWorkbench

IBMUnstructuredData751, p. 391

Page 401: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

FilterFiltersareamixofuser-createdandsystem-providedobjectsthatcanbeappliedtoinfosets.Youcanapplyseveralfilterattributestoaninfoset,continuallyrefiningituntiltheinfosetrepresentstheexactamountofdatathatyouneed.

Filtersarepersistentobjectsthatcanbenamedandreferenced.Whenafilterisappliedtoaninfoset,youcanrefinetheinfosetintoasmallerinfoset.Likeinfosets,detailsabouthowthefiltersworkareabstractedawayfromtheuser.Thefiltercancreatearawexpression.TheunderlyingAPIthencreatestheappropriatequeriestobreakdowntheinfosetintoitsappropriatesubset.

Filterscanbereusedacrossmultipleinfosets.Theabilitytoreplicatetheprocessoffilteringallowstheuserstoreplayworkflowprocesses.Inthisfashion,businessusersorknowledgeworkerscancapturerefinementtechniquesthattheymightwanttoapplytovariousdata.

InfosetexampleYouhaveasysteminfosetthatcontainsallfiles,emails,anddocumentsthatpertaintoallcompanyemployees,includingauserthatisnamedJoshSmith.Sincethissysteminfosetislargeandunwieldy,youneedtorefineitsothatyouhavetwoinfosets.OneinfosetrepresentsallofJoshSmith'semailthatcontainsanemailsubjectofstockoptionsandanotherthatrepresentsJosh'sfilesthatarelargerthan1GB.

Usingthisinformation,youcanrefinethesysteminfosetbyapplyingafilterwiththeseattributes:

AnythingthatJoshSmithowns.Tofindthisinformation,applyanamefilterwheretheownerisJoshSmith.OnlyJoshSmith'semail.Tofindthoseemails,applyafilefilterthatlooksforthe.MSGextension.AllofJoshSmith'semailsthathadanemailsubjectofstockoptions.Tofindthiskindofemails,applyanemailfilterthatfindsemailswithasubjectofstockoptions.

Thesefiltersandattributesgiveyoutheresultthatyouwant:AllofJoshSmith'semailswithanemailSubjectofStockOptions.

Additionally,youalsoneedtocreateaninfosetthatrepresentsJosh'sfiles.Thesefilesarelargerthan1GB.Usingthepreviousinformation,thesameinfosetrepresentsallofthefilesandemailsthatareassociatedwithJoshSmith.Therefore,youcanagainrefinetheinfosetbyapplyingafilterwiththeseattributes:

AnythingthatJoshSmithowns.Tofindthisinformation,applyanamefilterwheretheownerisJoshSmith.AllofJoshSmith'sfilesthatarelargerthan1GB.Tofindthesefiles,applyfilterwithanattributeofsizelargerthan1GB.

Theapplicationofthatlastfilterattributesiswhatgivesyoutheresultthatyouwant:AllofJoshSmith'sFilesLargerthan1GB.

Parenttopic:KeyconceptsofIBMStoredIQDataWorkbench

RelatedconceptsKeyconceptsofIBMStoredIQDataWorkbench

IBMUnstructuredData751, p. 392

Page 402: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

OverlayOverlaysareconfigurablefiltersthatdisplayhitsormatchesinaselectedinfoset.

Withinthedatamap,colorintensitiesfordataobjectsthatmatchtheoverlaychange.Thegreatertheoverlaymatches,themoreredthattileappearswithinthedatamap.

Parenttopic:KeyconceptsofIBMStoredIQDataWorkbench

RelatedconceptsKeyconceptsofIBMStoredIQDataWorkbench

IBMUnstructuredData751, p. 393

Page 403: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ScopeoperationContaineddata,suchasdatawithin.ZIP,.TAR,or.PSTfiles,ishierarchicalandcanhavemanydifferentrelationshipandconnections.Dependingonhowthatdataisviewed,thatdatacangiveadifferentperceptionthanwhatisrepresented.TheScopeOperationstabhelpsuserstounderstandmorefullywhatdataisrepresentedbydatasets.

Withinscopeoperations,youcanconductexpansionorcollapseoperations.

Inanexpandoperation,allfileswithinaninfosetareexpanded,causingthecreationofanew,potentiallymoreaccurateinfoset.Note:Ifthefileswithintheinfosetarenotcontainerfiles,thentheExpandoperatorhasnoeffect.Inacollapseoperation,allopenedorexpandedfileswithinaninfosetarecollapsed,causingthecreationofanew,smallerinfoset.Note:Ifthefileswithintheinfosetarenotcontainerfiles,thentheCollapseoperatorhasnoeffect.

Parenttopic:KeyconceptsofIBMStoredIQDataWorkbench

RelatedconceptsKeyconceptsofIBMStoredIQDataWorkbench

IBMUnstructuredData751, p. 394

Page 404: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ActionAnactionisanactivitythatiscreatedbyanadministratorandconductedonaninfoset.AvailableIBM®StoredIQDataWorkbenchactionsincludecopy,copytoretention,delete,discoveryexport,modifyattribute,move,andsnippetstep-up.

Althoughactionsaretheonlyobjecttotouchlivedata,theydonotalterinfosets.Aninfosetisagroupingofdata,notthedataitself,andactionsareappliedtotheactualobjects,nottheinfoset.Whenyoucopy,youcopytheactualfile,nottheinfoset.Thesameistrueforcopyingtoretentionordiscoveryexport.Additionally,actionscanbescheduledtorunimmediatelyoratapredeterminedtimeanddate.

Parenttopic:KeyconceptsofIBMStoredIQDataWorkbench

RelatedconceptsKeyconceptsofIBMStoredIQDataWorkbench

IBMUnstructuredData751, p. 395

Page 405: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ReportIBM®StoredIQDataWorkbenchreportingfunctionprovidesexternalviewsofinfosetsandvalidatesIBMStoredIQprocesses.ReportscanalsobecustomizedwiththeBIRTReportDesigner.

Youcansharetheinformationthatiscontainedwithininfosetswiththereportingcomponent,whichallowsinfosetstobetransferredtoothermediatypesforreviewandanalysis.Thesereportsdonotaffectexistinginfosets,butprovideyouwithmoreusableformatsinwhichtounderstandthefilesanddatathatiscapturedbyaninfoset.

Reportingisakeystepwithinthedata-managementprocessasitvalidatesthatprocesseswerecompletedcorrectlywithinIBMStoredIQ.Youcancustomizereportsinanyofthesescenarios:

Modifyreportstocarryyourorganization'scustomstylesandlogos,aligningthemwithotherorganization-basedartifactsanddocumentation.Altertheformatofthecontentreportedinexistingreports.Forexample,youcanaddmorecolumns,switchaxesinagraph,orchangetheunitsforsomevalues.Designreportstocontaininformationthatisnotfoundinother,existingreports

IBMStoredIQDataWorkbenchcontainsthesetypesofreports:

ComplianceReportDataAssessmentReportDataTopologyReportOverlayHitReportCSVExceptionListExportReportCSVDataObjectExportReportDuplicationSummaryReport

Parenttopic:KeyconceptsofIBMStoredIQDataWorkbench

RelatedconceptsKeyconceptsofIBMStoredIQDataWorkbench

IBMUnstructuredData751, p. 396

Page 406: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

InfosetmanagementTheinfosetwindowprovidesthefollowinghigh-levelinformationforaselectedinfoset.

Table1.InfosetheadingnamesanddescriptionsInfosetColumn

Name Description

NameThislistreflectsthenameoftheselectedinformationset.Aninfosetmustbeselectedbeforeyoucanviewdetailedinformation,conductanalyses,oractonit.

Totalobjects

Thenumberofdataobjectsthatarecontainedwithintheinfoset.Ifyouplacethemouseoverthenumberoftotalobjects,awindowappears.Itshowsthenumberoftop-levelandchild-levelobjectsthatarecontainedwithinthetotalnumberofobjects.Note:Iftheinfosetisstillbeingcreated,onlytheDetailswindowisactive.Infosetsthatarestillbeingcreatedlist0inthiscolumn.

Infosetsize Thesizeoftheinfoset.

Composition Thecompositionofthedatathatiscontainedwithinaninfoset,eitherMixedorTopLevel.

CreatedThedateandtimeatwhichtheinfosetwascreated.Note:SysteminfosetsarelistedasN/Ainthisfield,anduserinfosetslistthecreationdate,eveniftheircreationstatusshowspending.

Type Thetypeofinfoset,eitherUserorSystem.

Access

ThisoptionlistswhethertheinfosetisPublicorPrivateorthenameofpersonornumberofpeoplewhohaveaccesstotheinfoset.Ifyouplaceyourmouseoverthenumberofpeople,atooltipappearswiththenamesofthoseuserswhohaveaccess.Ifyouclickthelink,awindowwiththeusers'namesandrolesappears.

Creator Thepersonthatoriginallycreatedtheinfoset.Forolderinfosets,thecreatorislistedasN/A.

Description Abriefdescriptionoftheinfoset,whichwasprovidedduringinfosetcreation.

CreatinganinfosetInfosetscanbecreatedtoincludethedatamapanditsfunction,ortheycanexcludedatamaps,resultinginafastercreationtime.Additionally,youcaninterruptinfosetsduringtheircreation.InterruptinginfosetcreationInfosetcreationcansometimesexceedthetimethatyouhaveavailable.Infosetinterruptionmakesitpossibleforyoutooptoutofthecreationprocess.SearchingforaspecificinfosetWhenyouhavemultipleinfosetsavailabletochoose,youcansearchforaspecificinfosetinsteadofusingtheslidertomovethroughavailableoptions.CreatinganoverlayCreatedfiltersappearasoverlayoptionsduringinfosetcreation.EditinganinfosetWhenyouareeditinganexistinginfoset,youcanmodifyonlytheinfoset'snameanddescription.DeletinganinfosetInfosetscanbedeletediftheyareinterruptedduringtheircreation.ViewoftheinfosetdetailsYoucanusetheDetailstabtoviewdetailedinformationaboutaselectedinfosetandanyupdatesthataremadetothedatasourcesusesbytheinfoset.

IBMUnstructuredData751, p. 397

Page 407: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

CreatinganinfosetInfosetscanbecreatedtoincludethedatamapanditsfunction,ortheycanexcludedatamaps,resultinginafastercreationtime.Additionally,youcaninterruptinfosetsduringtheircreation.

AboutthistaskInfosetsarecreatedfromotherexistingsysteminfosets.

Tocreateaninfosetfromanexistinginfoset:

Procedure1. Selecttheinfosetfromwhichyouwanttocreateanewinfoset.Itcanbeeitherasystem

oruserinfoset.Thenameoftheselectedinfosetappearsintheinfosetwindow.2. ClickCreate,andthenselectafilterintheNamecolumnintheLibrarytab.

Note:Ifthiscreationisyourfirsttimetocreateaninfoset,youmustcreateacustomfilter.SeeCreatingaCustomFilter.

3. ClickCreateNewInfoset.TheCreateNewInfosetdialogboxappears.4. IntheNewInfosetNametextbox,enterthenameofthisinfoset.5. IntheDescriptiontextbox,enterthedescriptionofthisinfoset.6. SelectorcleartheIncludeDataMapcheckbox.

Ifyouselectthischeckbox,thedatamapisgeneratedforthisinfoset.Theinfosettakeslongertogenerate,butyouareabletousethedatamapanditsfunctionforthisinfoset.Ifyouclearthischeckbox,theinfosetgeneratesmorequickly,butitdoesnotincludethedatamap.Note:Ifyouopttocreateaninfosetwithoutadatamap,someofthereportsthatcanberunagainstthatinfosetareaffected.IftheCompliance,DataAssessment,DataTopology,Overlay,andCustomizedReportsarerunagainstaninfosetwithoutadatamap,theycontainnodata.

7. ClickSelectoverlaysforthisinfosettodeterminewhichoverlaysmustbeappliedtothisinfoset.Whenyouareexploringthisinfoset,theseselectedoverlaysareavailabletobeappliedwithinthedatamap.Note:Ifthedatamapisnotgenerated,thenoverlayscannotbeselected.

8. Tosendanotificationemailthattheinfosetwascreated,selectSendemailwhentheprocessiscompletecheckboxandentertheemailaddressatwhichtheindividualmustbenotified.

9. ClickSaveandViewtogototheDetails/InfosetAncestrytab,orclickSavetobegininfosetcreationandclosethedialogbox.

Parenttopic:Infosetmanagement

RelatedconceptsInfosetmanagement

IBMUnstructuredData751, p. 398

Page 408: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

InterruptinginfosetcreationInfosetcreationcansometimesexceedthetimethatyouhaveavailable.Infosetinterruptionmakesitpossibleforyoutooptoutofthecreationprocess.

AboutthistaskInfosetcreationcontainsdifferentforms.Insomeinstances,youmightwanttointerrupttheinfoset'screation,preservewhatwasfound,andthenlogtheunfinishedworkasanexception.Inotherinstances,youmightwanttohaltinfosetcreationandthendeletethatinfosetaltogetheranddeletinganyartifactsfromthecreationprocess.

AfteraninterruptedandpartiallycreatedinfosetwasmovedfromCreated>Interrupted>Completed,youcanusethatinfoset.However,youmustkeepinmindthatthecompletionstatedependsonwhentheinfosetisstopped.Whenyouaredeletinganinfosetpartwaythroughitscreation,clickDelete.Whenaninfosetisdeleted,itisnolongeravailablewithintheuserinterface.Ifaninfosetisprocessing,aStopProcessinglinkisavailablewithinthedashboard.Duringthisprocessingstate,thislinkcanbeusedtointerruptitscreationandaccesstheStopProcessingconfirmationwindow.

Tostopinfosetcreation:

Procedure1. Duringinfosetcreation,intheCreateNewInfosetdialogbox,clickSaveandVieworSave.Note:IntheTotalobjectsandInfosetsizecolumns,theinfosetislistedasPending.

2. Tostoporinterruptinfosetcreation,youcandoeitherofthefollowingsteps:Selectthependinginfoset,andthenclickStop.Ifthependinginfosetisactive,clickStopProcessing.

3. ClickOKtoverifyyouraction.Note:Theinfoset'screationisnowchangedtoInterrupting.ItthenmovestoaCompletedstate.Note:Ifyouopttousethisinterruptedinfoset,itisonlyapartialinfosetasitscreationwasinterrupted.

4. Exploreordeleteyourinfoset.ClickDelete,deletingtheinfosetfromtheuserinterfaceandtheinfosetlibraryasawhole.Selecttheinfosetandexploreitscontentjustasyoudowithanyotherinfoset.Youcanrefineitscontent,applyactions,andviewexceptionsoninterruptedinfosets.

Parenttopic:Infosetmanagement

RelatedconceptsInfosetmanagement

IBMUnstructuredData751, p. 399

Page 409: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

SearchingforaspecificinfosetWhenyouhavemultipleinfosetsavailabletochoose,youcansearchforaspecificinfosetinsteadofusingtheslidertomovethroughavailableoptions.

Procedure1. Intheinfosetwindow,clickthedownarrow.Acompletelistingofallavailableinfosets

appears.2. IntheEnterkeytermstosearch....textbox,enterthenameoftheinfosetforwhichyou

wanttosearch,andthenpressSearch.Youcanentereitherthefullinfosetnameoraportionofit.Toremovethesearchterm,clicktheXtotheleftoftheEnterkeytermstosearch....textbox.Infosetsthatmatchtheenteredsearchtermarereturned.

3. Clicktheinfosetthatyouwanttoselect,andthenclickSelectInfoset.Theselectedinfosetappearsatthetopoftheinfosetwindow.

Parenttopic:Infosetmanagement

RelatedconceptsInfosetmanagement

IBMUnstructuredData751, p. 400

Page 410: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

CreatinganoverlayCreatedfiltersappearasoverlayoptionsduringinfosetcreation.

Procedure1. Selecttheinfosetforwhichyouwanttocreateanoverlay.Thenameoftheselected

infosetappearswithintheinfosetwindow.2. ClickCreate,andthenclickBuildFilter.3. Createandsaveafilter.4. ClickCreateNewInfosetandnamethenewlycreatedinfoset.

Note:Savedfilterscanbeusedasoverlaysformultipleinfosets.Note:Thedatamapmustbeenabledforoverlaystobeadded.

5. Selectanoverlayorseveraloverlaysfromtheoverlaylist,andthenclickeitherSaveandVieworSave.

Parenttopic:Infosetmanagement

RelatedconceptsInfosetmanagement

IBMUnstructuredData751, p. 401

Page 411: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

EditinganinfosetWhenyouareeditinganexistinginfoset,youcanmodifyonlytheinfoset'snameanddescription.

Procedure1. IntheInfosetwindow,usethedownarrowtoselecttheinfosetthatyouwanttoedit.2. ClickEdit,whichisintheupperrightcorneroftheinfosetwindow.Note:Becausesysteminfosetscannotbeedited,thisEditlinkisdisabledifasysteminfosetisselectedwithintheinfosetwindow.TheEditInfosetdialogboxappears.

3. IntheEditInfosetdialogbox,youcaneditonlytheinfoset'snameanddescription.ClickwithineithertheNameorDescriptiontextboxestoedittheinfoset.

4. ClickSavetosaveyourmodifications.

Parenttopic:Infosetmanagement

RelatedconceptsInfosetmanagement

IBMUnstructuredData751, p. 402

Page 412: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DeletinganinfosetInfosetscanbedeletediftheyareinterruptedduringtheircreation.

AboutthistaskInfosetscanbedeletedinboththeCompletedandPendingstates.Aninfosetcannotbedeletedunderthesecircumstances:

Ifaninfosetwascreatedwithanotherinfosetasitssource,thenthechildinfosetmustbedeletedbeforeyoudeletetheparentinfoset.Ifanactionwasrunorisrunningagainsttheinfoset,thentheinfosetcannotbedeleted.

Todeleteaninfoset:

Procedure1. IntheInfosetwindow,usethedownarrowtoselecttheinfosetyouwanttodelete.2. ClickDelete,andthenclickOK.

Note:Deletinganinfosetpermanentlyremovesitshistory.

Parenttopic:Infosetmanagement

RelatedconceptsInfosetmanagement

IBMUnstructuredData751, p. 403

Page 413: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ViewoftheinfosetdetailsYoucanusetheDetailstabtoviewdetailedinformationaboutaselectedinfosetandanyupdatesthataremadetothedatasourcesusesbytheinfoset.

TherearethreetabswithintheDetailsarea:InfosetAncestry,ExecutionLog,andDataObjects.

TheInfosetAncestrytabshowsthehistoryandgenealogyoftheselectedinfoset.Forexample,itdisplaysthesysteminfosetfromwhichtheuserinfosetwascreatedandwhichfilterwasused.

Additionally,theInfosetDetailssectionprovidesthefollowinginformationaboutaselectedinfoset.

Table1.InfosetAncestryColumnDefinitionsInfosetAncestryColumnHeading Definition

Name Thenameoftheitemselected.Created Thedateandtimetheselecteditemwascreated.Type Theitem'stype,eithersystemoruserinfoset,filter.Description Thedescriptionoftheselecteditem.

ViewinginfosetancestryViewinfosetancestryfromtheDetailswindow.SavinginfosetancestryasaworkflowInfosetscanbesavedasworkflowsinIBM®StoredIQDataScriptdocuments,thestartingandendpointsforwhicharethefirstandlastoperationsintheinfoset'sancestry.ExecutionlogWhentheExecutionLogtabisselected,youcanseethename,status,therunstarttime,andthelengthoftimeofanactionran.ViewingactionlogofinfosetsByselectinganactionintheNamecolumn,theActionDetailssectionprovidesinformationaboutthataction,includingname,description,status,andwhichinfosetsitwaslastusedon.GeneratinganauditreportAuditreportscanbegeneratedforactionsselectedwithintheExecutionLog.ViewingdataobjectsWhentheDataObjectstabisselected,thedataobjectlistreturnsobjectsintheinfoset.Youcanalsospot-checkdataobjectswithinaninfosetwiththedataobjectviewer.

Parenttopic:Infosetmanagement

RelatedconceptsInfosetmanagement

IBMUnstructuredData751, p. 404

Page 414: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ViewinginfosetancestryViewinfosetancestryfromtheDetailswindow.

Procedure1. Verifythatyouselectedtheinfosetforwhichyouwanttoviewitsancestry.2. IntheDetailswindow,clicktheInfosetAncestrytab.Thistabisselectedbydefault.3. IntheNamecolumn,clickthenameoftheitemforwhichyouwanttoviewancestryinformation.TheAncestorInfosetDetailsareapopulateswiththename,description,totalobjects,top-levelobjects,childobjects,infosetsize,composition,createddate,type,andcreator.TheAncestorFilterDetailsareadisplaysname,description,alinktoviewthefiltercode,createddate,andtype.

Parenttopic:Viewoftheinfosetdetails

RelatedconceptsViewoftheinfosetdetails

IBMUnstructuredData751, p. 405

Page 415: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

SavinginfosetancestryasaworkflowInfosetscanbesavedasworkflowsinIBM®StoredIQDataScriptdocuments,thestartingandendpointsforwhicharethefirstandlastoperationsintheinfoset'sancestry.

Procedure1. IntheDetailswindow,clicktheInfosetAncestrytab.Thistabisselectedbydefault.2. ClickSaveAncestryasWorkflow.TheCreateWorkflowdialogboxappears.3. IntheCreateWorkflowdialogbox,completethesefields.

IntheNametextbox,enterauniquenameforthisworkflow.IntheDescriptiontextbox,enteradescriptionofthisworkflow.

4. ClickSave.Afterthisancestryissavedasaworkflow,itisavailableinotherrelatedapplicationssuchasIBMStoredIQDataScript.

Parenttopic:Viewoftheinfosetdetails

RelatedconceptsViewoftheinfosetdetails

IBMUnstructuredData751, p. 406

Page 416: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ExecutionlogWhentheExecutionLogtabisselected,youcanseethename,status,therunstarttime,andthelengthoftimeofanactionran.

TheExecutionLogcolumnisdefinedasfollows.

Table1.ExecutionLogColumnDefinitionsExecutionLog

ColumnHeading Definition

Name Thenameoftheactionontheselectedinfoset.Status Thestatusoftheactionontheselectedinfoset.Type Thetypeofactionbeingrunontheselectedinfoset.

RunstartedThetimeatwhichtheactionwasstarted.Byclickingthearrowtotherightofthecolumnname,youcanlistthecolumninascendingordescendingorder.

Runduration Thelengthofruntimeoftheselectedaction.

Parenttopic:Viewoftheinfosetdetails

RelatedconceptsViewoftheinfosetdetails

IBMUnstructuredData751, p. 407

Page 417: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ViewingactionlogofinfosetsByselectinganactionintheNamecolumn,theActionDetailssectionprovidesinformationaboutthataction,includingname,description,status,andwhichinfosetsitwaslastusedon.

Procedure1. Verifythatyouselectedtheinfosetforwhichyouwanttoviewitsactionslog.2. IntheDetailswindow,clicktheExecutionLogtab.3. IntheNamecolumn,clickthenameoftheactionforwhichyouwanttoviewlog

information.TheActionDetailsareapopulates,displayingname,description,status,theinfosetonwhichtheactionwaslastused,anyexceptions,andtheGenerateReportlink.Ifyouclicktheexceptionspercentage,theExceptionstabappears,providingyouwithgreatercontextanddetail.

WhentheGenerateReportlinkisclickedandanauditreportisgenerated,aSourceActiondetailbecomesavailable,showingthereport'sname,thedateandtimeitwascreated,andthelengthoftimenecessarytogeneratethereport.Ifthereportisbeinggenerated,itsstatusisshownasRunning.Whenthereporthasfinishedgenerating,itcanbeviewedbyclickingtheDownloadReportlinkwithinStatus.

Parenttopic:Viewoftheinfosetdetails

RelatedconceptsViewoftheinfosetdetails

IBMUnstructuredData751, p. 408

Page 418: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

GeneratinganauditreportAuditreportscanbegeneratedforactionsselectedwithintheExecutionLog.

AboutthistaskActionAuditReport

TheActionAuditReportprovidesdetailedinformationintheseareas:

ExecutionSummaryDataObjectResultCountSummaryInfosetSummaryParticipatingDataServerandVolumeSummaryActionParameters

Procedure1. Verifythatyouselectedtheinfosetforwhichyouwanttogenerateanauditreport,andthenclickDetails>ExecutionLog.

2. IntheActionDetailsarea,clickGenerateReport.TheGenerateAuditReportdialogboxappears.

3. IntheReportNametextbox,thereport'snameisprefilled,basedontheselectedactionintheExecutionLog.

4. IntheSendTo:textbox,entertheemailaddressestowhomthisreportissent.Separatemultipleemailaddresseswithacomma.

5. ClickGenerate,andtheauditreportgenerates.Whentheauditreportisgenerating,itsstatuschangestoRunninginboththeActionDetailsareaandtheExecutionLog.Whenthereportisgenerated,itissenttotheemailaddressesenteredintheSendTo:textbox,anditcanbeopenedfromthatemail.ThereportcanalsobedownloadedwithintheExecutionLog.

Parenttopic:Viewoftheinfosetdetails

IBMUnstructuredData751, p. 409

Page 419: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ViewingdataobjectsWhentheDataObjectstabisselected,thedataobjectlistreturnsobjectsintheinfoset.Youcanalsospot-checkdataobjectswithinaninfosetwiththedataobjectviewer.

AboutthistaskNote:Byclickingadataobject,youcanviewtheobjectitselfusingthedataobjectviewer.

Table1.DataobjectsdefaultcolumndefinitionsDataObjects

ColumnHeading Definition

Filename Thenameofthefilewithintheelectedinfoset.Filesize Thesizeofthefile.Filepath Thedirectorypathofthefile.Created Thecreationdateandtimeofthefile.Lastmodified Thedateandtimeatwhichthefilewaslastmodified.

Procedure1. IntheDetailswindow,clicktheDataObjectstab.Dataobjectswithintheinfosetare

returned;youcanseethedataobjectsthatarecontainedwithintheinfoset.2. Clickanobject'sfilenametoviewandverifythatobjectinthedataobjectviewer.3. ClickClosetoclosethedataobjectviewer.4. Configurecolumnswhenyouarereviewingdataobjects:

a. IntheDetailswindow,clicktheDataObjectstab.b. Clickthebluegearicon,andtheappears.c. IntheConfigureColumn-DataObjectsdialogbox,clickthedownarrowtotheright

ofoptions2-6,selectingthenameofthecolumn.Choosefromtheseoptions:None,Filesize,Filepath,Filetype,Containerpath,Lastaccessed,Created,Lastmodified,Ownername,orGroupname.TheFilenameoptioncannotbechanged.Bydefault,itisthenameofthefirstcolumnwhenyouareviewingdataobjects.Additionally,asyourenamecolumns,morecolumnsareautomaticallyaddedtotheConfigureColumn-DataObjectsdialogbox.

d. Toresetthecolumnstothedefaultselections,clickResettodefaultcolumnselections.Thecolumnconfigurationoptionsreturntotheirdefaultsettings.

e. ClickSave.ThelayoutoftheDataObjectsareareflectsthechosenoptions.

Parenttopic:Viewoftheinfosetdetails

RelatedconceptsViewoftheinfosetdetails

IBMUnstructuredData751, p. 410

Page 420: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

FilteradministrationFiltersareobjectsthatcanbeappliedtoinfosets.Youcanapplyonefilterwithmultiplefilterattributestoaninfoset,continuallyrefiningthatinfosetuntilitrepresentsresponsivedatathatyouneed.

Note:AttributeswithinafiltercategoryareORed.Forexample,whenyouarecreatingafilefilterthatisdefinedbyfilenameandextensioncontains.DOC,thefiltersyntaxis"filenameORfileextensioncontainsdoc".Addinganotherfileattributecategory,thecategoriesareANDed.Therefore,thefilecategoryfilterattribute"extensionORfilenamecontainsdoc"andaddingthenamecategorywith"ownernameJohnSmith,"thesyntaxis"filename"OR"extensioncontainsdoc"AND"ownernamescontainsJohnSmith."

TherearefourtabsontheCreatepage:Library,BuildFilter,SetOperations,andScopeOperations.

LibraryofavailablefiltersTheLibrarytablistsallfiltersthatarecreatedandavailableforusewithinfosets.

IBMUnstructuredData751, p. 411

Page 421: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

LibraryofavailablefiltersTheLibrarytablistsallfiltersthatarecreatedandavailableforusewithinfosets.

WithintheLibrarytab,youcanviewthenamesanddescriptionsofallsavedfilters.Additionally,youcaneditanddeletethosefilters.

SearchingforanexistingfilterSearchforanexistingfilterwithintheLibrarytab.EditingafilterAfterfiltersarecreatedandsaved,theycanbeedited.ViewingfiltercodeDeletingafilterFilterscanbedeletedwhentheyarenolongerusedbyaninfoset.BuildingafilterCreateafiltertocustomizeyoursearchforspecificdata.PreviewingfilterresultsYoucanpreviewsample,returneddatabeforeyousavethatinfoset.ConfiguringcolumnswhenpreviewingfilterresultsWhenyoupreviewdataobjectsthatarecontainedwithinaninfoset,youcanselectwhattypeofinformationisdisplayed,ensuringthatthereturneddataismeaningfultoyou.SetoperationsAsetoperationallowsinfosetstobecombinedindifferentwaystoproduceanotherinfoset.ScopeoperationsContaineddata,suchasdatawithin.ZIP,.TAR,or.PSTfiles,ishierarchicalandcanhavemanydifferentrelationshipandconnections.Dependingonhowthatdataisviewed,thatdatacangiveadifferentperceptionthanwhatisrepresented.TheScopeOperationstabhelpsuserstounderstandmorefullywhatdataisrepresentedbydatasets.

Parenttopic:Filteradministration

RelatedconceptsFilteradministrationSetoperationsScopeoperations

RelatedtasksSearchingforanexistingfilterEditingafilterViewingfiltercodeDeletingafilterBuildingafilterPreviewingfilterresultsConfiguringcolumnswhenpreviewingfilterresults

IBMUnstructuredData751, p. 412

Page 422: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

SearchingforanexistingfilterSearchforanexistingfilterwithintheLibrarytab.

Procedure1. ClickCreate,andthenclicktheLibrarytab.2. IntheEnterkeytermshere....textbox,enterthenameofthefilterforwhichyouwantto

search,andthenpressSearch.Youcanentereitherthefullfilternameoraportionofit.Toremovethesearchterm,clicktheXtotheleftoftheEnterkeytermshere....textbox.

Filtersthatmatchtheenteredsearchtermarereturned.TheFilterDetailsareadisplaysthefilter'sname,description,alinktoviewthefilter'scode,andthenameoftheinfosetinwhichthefilterwaslastused.

Parenttopic:Libraryofavailablefilters

Parenttopic:Buildingafilter

RelatedconceptsLibraryofavailablefilters

RelatedtasksBuildingafilter

IBMUnstructuredData751, p. 413

Page 423: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

EditingafilterAfterfiltersarecreatedandsaved,theycanbeedited.

Procedure1. ClickCreate>Library,andthenselectthenameofthefilterthatyouwanttoedit.2. ClickEdit.TheEditFilterdialogboxappears.3. Editthefilterasneeded,determiningthefilter'sscopeandvalidatingthecode.4. ClickSavetosaveyourchanges.

Parenttopic:Libraryofavailablefilters

RelatedconceptsLibraryofavailablefilters

IBMUnstructuredData751, p. 414

Page 424: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Viewingfiltercode

Procedure1. WithintheFilterDetailsarea,clickViewFilterCode.TheFilterCodewindowappears.2. ClickClosetoclosetheFilterCodewindow.

Parenttopic:Libraryofavailablefilters

RelatedconceptsLibraryofavailablefilters

IBMUnstructuredData751, p. 415

Page 425: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DeletingafilterFilterscanbedeletedwhentheyarenolongerusedbyaninfoset.

Procedure1. ClickCreate>Library,andthenselectthenameofthefilterthatyouwanttodelete.2. ClickDelete.TheFilterDeleteConfirmationdialogappears.3. ClickOKtodeletethefilter,orclickCanceltocancelthedeletion.Ifthefilterisdeleted,

itisremovedfromthelistofavailablefilterswithintheLibrarytab.

Parenttopic:Libraryofavailablefilters

RelatedconceptsLibraryofavailablefilters

IBMUnstructuredData751, p. 416

Page 426: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

BuildingafilterCreateafiltertocustomizeyoursearchforspecificdata.

Procedure1. ClickCreate,andthenclicktheBuildFiltertab.2. Selectthecheckboxorboxesofthetypeoffilterattributethatyouwanttocreate.Dependingonthetypeoffilteryouarecreating,selectfromtheseoptions:File,Date,Size,Name,Email,FullText,andAuto-Classification.Option Description

File Filefiltersarebasedoncommonfilefieldssuchasfilename,filepath,containerpath,andextension.

Date Datefiltersarebasedoncommondateinformationsuchaccessed,modified,orcreateddates.

Size Sizefiltersarebasedoncommondata-objectfilesizefieldsuchasbytes,KB,MB,andGB.

Name

NamefiltersarebasedonnameparameterssuchastheownernameorSharePointowner.

Email EmailfiltersarebasedoncommonemailfieldssuchasTo,From,CC.

FullText

Full-textfiltersarebasedonasimplesearchstringagainstalldataobjects.Thisoptionreturnsresultsonlyforfull-textharvests.

Auto-classify

Auto-classifyfiltersarebasedonthestep-upsnippetaction.Theycanberunonaninfoset,extractingandstoringtextforanydataobjecttowhichitisapplied,andtheauto-classificationenhancement.

3. IntheFilterDetailsarea,enteranameanddescriptionforthenewlycreatedfilter,andthenclickSaveFilter.ThenewlycreatedfiltercanbeseenwithintheLibrarytab.

CreatingafilefilterFilefiltersareatypeofcustomizedfilters.Filefiltersarebasedoncommonfilefieldssuchasname,extension,andpath.CreatingadatefilterDatefiltersarebasedoncommondateinformationsuchasaccessed,modified,orcreateddates.CreatingasizefilterSizefiltersarebasedoncommondata-objectfilesizefieldsuchasbytes,KB,MB,andGB.CreatinganamefilterNamefiltersarebasedonnameparameterssuchastheownernameorSharePointowner.CreatinganemailfilterEmailfiltersarebasedoncommonemailfieldssuchasTo,From,CC,BCC,andemailsubject.Creatingafull-textfilterFull-textfiltersarebasedonasimplesearchstringforfull-textindexedobjects.Onlyobjectsthatwerefull-textindexedreturnresults.Creatinganauto-classificationfilterAuto-classificationfiltersarebasedontheauto-classificationmodelthatiscreatedinIBM®StoredIQAdministrator.SearchingforanexistingfilterSearchforanexistingfilterwithintheLibrarytab.CreatingcustomizedsearcheswiththecodeviewUsethecodeviewtocreatecustomizedsearcheswithsearchsyntax.

IBMUnstructuredData751, p. 417

Page 427: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Parenttopic:Libraryofavailablefilters

RelatedconceptsLibraryofavailablefilters

IBMUnstructuredData751, p. 418

Page 428: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

CreatingafilefilterFilefiltersareatypeofcustomizedfilters.Filefiltersarebasedoncommonfilefieldssuchasname,extension,andpath.

Procedure1. SelecttheinfosetandthenclickSelectInfoset.Theselectedinfosetappearsinblue.2. ClickCreate,andthenclicktheBuildFiltertab.3. SelecttheFilecheckbox,andthencompletefollowingsteps.

a. IntheContainslist,selecteitherContains,Is,orBeginswith.b. Inthetextbox,enterthetext.c. Selectthecheckboxforwhattheparticularfilteruses,choosingfromFileName,

Extension,FilePath,orContainerPath.Youcanselectanyorallofthefiletypefilteroptions.

4. IntheFilterDetailsarea,completethefollowingsteps.a. IntheFilterNametextbox,enterthenameofthisnewfilter.b. IntheDescriptiontextbox,enterabriefdescriptionofthisfilter.c. ClickSaveFilter.

ResultsThecustomfilteriscreatedandsaved,anditcannowbeaccessedfromtheLibrarytab.

Parenttopic:Buildingafilter

RelatedtasksBuildingafilter

IBMUnstructuredData751, p. 419

Page 429: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

CreatingadatefilterDatefiltersarebasedoncommondateinformationsuchasaccessed,modified,orcreateddates.

Procedure1. ClickCreate,andthenclicktheBuildFiltertab.2. SelecttheDatecheckbox,andthencompletefollowingsteps:

a. Inthelistofoperators,selectAfter,Before,On,orBetween.b. IntheDatetextbox,enterthedateforthiscustomfilter.c. Selectthecheckboxastowhatfieldstowhichthedatefilterapplies,choosingfrom

Accessed,Modified,orCreated.Youcanselectanyorallofthedate-typefilteroptions.

d. IntheFilterDetailswindow,enterthenameofthisnewfilter.e. IntheDescriptiontextbox,enterabriefdescriptionofthisfilter.f. ClickSaveFilter.

ResultsThecustomfilteriscreatedandsaved,anditcannowbeaccessedfromtheLibrarytab.

Parenttopic:Buildingafilter

RelatedtasksBuildingafilter

IBMUnstructuredData751, p. 420

Page 430: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

CreatingasizefilterSizefiltersarebasedoncommondata-objectfilesizefieldsuchasbytes,KB,MB,andGB.

Procedure1. ClickCreate,andthenclicktheBuildFiltertab.2. SelecttheSizecheckbox,andthencompletefollowingsteps:

a. Inthelistofoperators,selectMoreThan,LessThan,Is,orBetween.b. Intheemptytextboxbetweenthelists,enterthenumberthatappliestothis

customsizefilter.c. Inthesizevaluelist,selectbytes,KB,MB,orGB.d. IntheFilterDetailswindow,enterthenameofthisnewfilter.e. IntheDescriptiontextbox,enterabriefdescriptionofthisfilter.f. ClickSaveFilter.

ResultsThecustomfilteriscreatedandsaved,anditcannowbeaccessedfromtheLibrarytab.

Parenttopic:Buildingafilter

RelatedtasksBuildingafilter

IBMUnstructuredData751, p. 421

Page 431: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

CreatinganamefilterNamefiltersarebasedonnameparameterssuchastheownernameorSharePointowner.

Procedure1. ClickCreate,andthenclicktheBuildFiltertab.2. SelecttheNamecheckbox,andthencompletefollowingsteps:

a. Intheblanktextbox,entertheownerorSharePointownername.Note:Ifyouareenteringmorethanonename,separatethenameswithcommas.Forexample,youwouldentermultiplenamesasJohnSmith,MaryJones,EllenSideways.

b. Selectthecheckboxastowhatfieldstowhichthisnamefilterapplies,choosingfromOwnerorSharePointOwner.Youcanselectanyorbothofthename-typefilteroptions.

c. IntheFilterDetailswindow,enterthenameofthisnewfilter.d. IntheDescriptiontextbox,enterabriefdescriptionofthisfilter.e. ClickSaveFilter.

ResultsThecustomfilteriscreatedandsaved,anditcannowbeaccessedfromtheLibrarytab.

Parenttopic:Buildingafilter

RelatedtasksBuildingafilter

IBMUnstructuredData751, p. 422

Page 432: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

CreatinganemailfilterEmailfiltersarebasedoncommonemailfieldssuchasTo,From,CC,BCC,andemailsubject.

Procedure1. ClickCreate,andthenclicktheBuildFiltertab.2. SelecttheEmailcheckbox,andthencompletetheseoptions.

a. Intheblanktextbox,enterthenamesoremailaddressesthatisusedbythisfilter.Separatemultiplenamesoremailaddresswithcommas.YoumightenterJohnSmith,[email protected],[email protected].

b. Selectthecheckboxorboxestowhichthisemailfilterapplies,choosingfromTo,From,CC,BCC,orEmailSubject.Note:IfyouselecttheEmailSubjectcheckbox,youmustalsoselectanoperator:Contains,Is,orBeginsWith,andthenentersometextabouttheemail'ssubjectintotheemptytextbox.

3. IntheFilterDetailsarea,completethefollowingsteps.a. IntheNametextbox,enterthenameofthisnewfilter.b. IntheDescriptiontextbox,enterabriefdescriptionofthisfilter.c. ClickSaveFilter.

ResultsThecustomfilteriscreatedandsaved,anditcannowbeaccessedfromtheLibrarytab.

Parenttopic:Buildingafilter

RelatedtasksBuildingafilter

IBMUnstructuredData751, p. 423

Page 433: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Creatingafull-textfilterFull-textfiltersarebasedonasimplesearchstringforfull-textindexedobjects.Onlyobjectsthatwerefull-textindexedreturnresults.

Procedure1. ClickCreate,andthenclicktheBuildFiltertab.2. SelecttheFullTextcheckbox.3. Intheblanktextbox,enterthesearchstringthatisrunagainstdataobjectsinafull-text

index.YoumightenterstockoptionsANDCEOorAppleNOTIBM.4. IntheFilterDetailsarea,completethefollowingsteps.

a. IntheNametextbox,enterthenameofthisnewfilter.b. IntheDescriptiontextbox,enterabriefdescriptionofthisfilter.c. ClickSaveFilter.

ResultsThecustomfilteriscreatedandsaved,anditcannowbeaccessedfromtheLibrarytab.

Parenttopic:Buildingafilter

RelatedtasksBuildingafilter

IBMUnstructuredData751, p. 424

Page 434: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Creatinganauto-classificationfilterAuto-classificationfiltersarebasedontheauto-classificationmodelthatiscreatedinIBM®StoredIQAdministrator.

Procedure1. ClickCreate,andthenclicktheBuildFiltertab.2. SelecttheAuto-classificationcheckbox.3. WhatappearsinthisareaisdependentuponthemodelthatiscreatedinIBMStoredIQ

Administrator.a. Selectthecheckboxthatyouwant:Andthehighestscoreintheselectedcategory

orAndwherescoreis.Then,usetheliststoselectGreaterthan,Lessthan,orEqualtoandtheappropriatedecimalamount.

4. IntheFilterDetailsarea,completethefollowingsteps:a. IntheNametextbox,enterthenameofthisnewfilter.b. IntheDescriptiontextbox,enterabriefdescriptionofthisfilter.c. ClickSaveFilter.TheSaveCreatedFilterconfirmationappears,verifyingthatyou

wanttosavethisfilter.ClickOK.

Parenttopic:Buildingafilter

RelatedtasksBuildingafilter

IBMUnstructuredData751, p. 425

Page 435: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

CreatingcustomizedsearcheswiththecodeviewUsethecodeviewtocreatecustomizedsearcheswithsearchsyntax.

Procedure1. ClickCreate,andthenclicktheBuildFiltertab.2. ClickCodeView.Note:Toreturntothefilter'sformviewontheBuildFiltertab,clickFilterFormView.Then,youcancreateandsavefilterswiththeprebuiltforms.

3. Inthelargetextbox,createandenteracustomizedsearchwithcorrectfiltersyntax.Formoreinformationaboutappropriatefiltersyntax,includingtipsandexample,seeSyntaxPrimer.

4. ClickValidateCode.Iftheenteredexpressionisvalid,amessagethatstatesThefilterexpressionpassedvalidationisreturned.Ifitisinvalid,amessagethatstatesThefilterexpressionisnotvalidisreturned.

5. IntheFilterDetailsarea,completethefollowingsteps.a. IntheNametextbox,enterthenameofthisnewfilter.b. IntheDescriptiontextbox,enterabriefdescriptionofthisfilter.c. ClickSaveFilter.

SyntaxprimerThisprimerofferssyntaxexamplesandtipsforusingBooleanoperators,multipletermsortermphrases,wildcard,andproximityfiltersforthefull-textfilterorfull-textsourcecodefilter.

Parenttopic:Buildingafilter

RelatedtasksBuildingafilter

IBMUnstructuredData751, p. 426

Page 436: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

SyntaxprimerThisprimerofferssyntaxexamplesandtipsforusingBooleanoperators,multipletermsortermphrases,wildcard,andproximityfiltersforthefull-textfilterorfull-textsourcecodefilter.

Note:Savedfiltersareavailableasoverlayswhenyouarecreatingnewinfosets.Formoreinformation,seeCreatingInfosets.

Booleanoperatorsyntax

ANDTheANDoperatorensuresthatbothtermsappearinthedataobject.Forexample,thequerychairmanANDstockreturnsdataobjectswherechairmanandstockappear.&&functionsthesameasAND.

ORTheORoperatorreturnsdataobjectswhereeithertermappears.ThequerychairmanORstockreturnsdataobjectsthathavechairman,stock,orbothinthedataobject.||functionsthesameasOR.

NOTTheNOToperatorensuresthatatermdoesnotappearinanydataobjectsreturned.ThequeryAppleNOTIBMreturnsdataobjectswherewordAppleappears,butnotIBM.!functionsthesameasNOT.

Multipletermsortermphrasesyntax

""and''Quotationmarksaroundatermphrasereturndataobjectsthatcontainthatphraseinthatorder.Forexample,“September201998”returnsonlydataobjectswiththeexactphraseofSeptember201998.Doublequotationmarksallowforwildcardsintermswhereassinglequotationmarksdonot.

Multi-item,noBooleanoperators

AsearchformultiplewordswithoutBooleanoperatorsorquotationmarksisanimpliedORsearch.Forexample,September201998returnsdataobjectsthathaveSeptemberOR20OR1998.Stopwordsareremoved.

Parentheses

GroupingwithBooleanoperatorsandparenthesescontrolshowoperatorsareevaluated.Forexample,($10ORbillion)ANDoptionsreturnsdataobjectswhere$10orbillionmightbeinthedataobject,butoptionsmustalsoexist.Booleanoperators(AND,OR,NOT)workinagroupingorinaproximitygroup.So("SaharaDesert"AND"SoutheastAsia")OR("PacificOcean"AND"Bavaria")returnsdataobjectsthathaveSaharaDesertandSoutheastAsiaorPacificOceanandBavaria.

Wildcardsyntax

Asingleasteriskfindsmultiplecharactersorlettersatbeginningofaterm.Afilterfor*ololreturnsresultsforbetaxolol,carteolol,levobetaxolol,levobunolol,metipranolol,andtimolol.Anasteriskmatchesanynumberofcharactersinthemiddleofaterm.

IBMUnstructuredData751, p. 427

Page 437: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

*(Asterisk) te*treturnsresultsfortext,test,tent,andtempest.Anasteriskthatisplacedafterapartialwordfindstermsthatbeginwiththoselettersattheendofaterm.Afilterforap*returnsresultsforApple,April,applied,andapplication.Anasteriskalonefindsallobjects.

?Thequestionmarkmatchesasinglecharacter.Forexample,compl?returnsresultsforcomplybutnotcomplies.Tofilterformorethanonecharacter,useaquestionmarkforeachletter,forexample,ap??e.

Proximitysyntax

w/x

Filteringusesthew/xsyntax(xrepresentsthenumberoftermsbetweenthetwoterms)tousetherelationshipbetweensearchterms.w/0matchestermsthatarenexttoeachotherinanyorder,andw/1matchestermswithonewordbetweenthem.Thetermscanappearinanyorder.Groupingwithproximityallowsforevenmoretargetedresults.Forexample,("stock"OR"option")w/3(2007)findseitherstockoroptionwithinthreetermsof2007.Termscanhavewildcardsorphrases.

pre/x

Thepre/xsyntax(xrepresentsthenumberofwordsbetweenthetwoterms)enablesuserstotargetproximityfiltersbydictatingwhichtermcomesbeforeanotherterm.Forexample,chairmanpre/15optionsreturnsdataobjectswherechairmancomesupto15termsbeforeoptions.pre/0matchestermsthatarenexttoeachotherandinthesameorder;pre/1matchestermswithatmostonewordbetweenthemandinthesameorder.Termscanhavewildcardsorphrases.

NotesregardingsyntaxWhenyouareexaminingtext,IBM®StoredIQevaluatestherequestedoperatorsandgivesprecedencetosomeoverothers.

Whenparenthesesareusedtogroupoperators,theexpressioninparenthesesisgiventhehighestprecedence.NOT:"OctoberNOTNovemberORDecember"means"(OctoberAND(NOTNovember))ORDecember".Proximityoperators("w/"and"pre/"):"Octoberw/3Novemberpre/5December"means"(Octoberw/3November)pre/5December".("October"and"November"mustbewithinthreewordsofeachother,butbothmustbebefore"December"bynomorethanfivewords.)"Octoberw/3NovemberandDecember"means"(Octoberw/3November)andDecember".TheANDoperator:"OctoberANDNovemberORDecember"means"(OctoberANDNovember)ORDecember".TheORoperatorornooperator:"OctoberNovemberORDecember"meansthesameas"(OctoberORNovember)ORDecember".

Parenttopic:Creatingcustomizedsearcheswiththecodeview

RelatedtasksCreatingcustomizedsearcheswiththecodeview

IBMUnstructuredData751, p. 428

Page 438: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

PreviewingfilterresultsYoucanpreviewsample,returneddatabeforeyousavethatinfoset.

Procedure1. Selecttheinfosetfromwhichyouwouldliketocreateanewinfoset.2. Applyafiltertothisinfosetbyeitherusinganexistingfilterorcreatinganewfilter.3. ClickPreviewFilterResults,anddatathatiscontainedwithinthatinfosetappearswithin

theFilterResults.Itincludesthename,filesize,filepath,itscreationdateandtime,andthedateandtimeitwaslastmodified.

Parenttopic:Libraryofavailablefilters

RelatedconceptsLibraryofavailablefilters

IBMUnstructuredData751, p. 429

Page 439: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ConfiguringcolumnswhenpreviewingfilterresultsWhenyoupreviewdataobjectsthatarecontainedwithinaninfoset,youcanselectwhattypeofinformationisdisplayed,ensuringthatthereturneddataismeaningfultoyou.

Procedure1. Selecttheinfosetfromwhichyouwanttocreateanewinfoset.2. Applyafiltertothisinfosetbyeitherusinganexistingfilterorcreatinganewfilter.3. ClickPreviewFilterResults,andalistofdataobjectsthatarecontainedwithinthat

infosetappears.4. Clickthebluegearicon.TheConfigureColumn-PreviewFilterResultsdialogbox

appears.5. IntheConfigureColumn-PreviewFilterResultsdialogbox,clickthedownarrowtothe

rightofoptions2-6,selectingthenameofthecolumn.Choosefromtheseoptions:None,Filesize,Filepath,Filetype,Containerpath,Lastaccessed,Created,Lastmodified,Ownername,orGroupname.Note:TheFilenameoptioncannotbechanged.Bydefault,itisthenameofthefirstcolumnwhenyouarepreviewingdata.Additionally,asyourenamecolumns,morecolumnsareautomaticallyaddedtotheConfigureColumn-PreviewFilterResultsdialogbox.

6. Toresetthecolumnstothedefaultselections,clickResettodefaultcolumnselections.Thecolumnconfigurationoptionsreturntotheirdefaultsettings.

7. ClickSave.ThelayoutoftheFilterResultsareareflectsthechosenoptions.

Parenttopic:Libraryofavailablefilters

RelatedconceptsLibraryofavailablefilters

IBMUnstructuredData751, p. 430

Page 440: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

SetoperationsAsetoperationallowsinfosetstobecombinedindifferentwaystoproduceanotherinfoset.

Setoperationsallowforthecombinationofinfosetsinnewanduniquewaysthatyoucanhighlightspecificinformationthatiscontainedwithintheinfoset.Youcanapplythesetypesofsetoperationstoinfosets:union,intersection,symmetricdifference,andsubtraction.

Table1.SetoperationsOperation Description Example

Union

Aunioninfosetisthecombinationoftwoormoreinfosets:theprimaryinfosetandthecheckboxesofwhateveravailableinfosetyouselect.

Forexample,youhavethreeinfosets,twoofwhichcontainPSTsbyownerandathirdthatcontainsallExchangeemail.Youwanttocombineallthreeinfosetstomakeiteasiertorunactionsonallofthedataobjectstherein.

Noticethatallthreeinfosetscombineintheirentirety,resultinginanew,largerinfoset.Thecombinationoftheaffectedareasisturnedgraywithintheinterface.

Intersection

Anintersectedinfosetistheresultoftwoormoreinfosetsthatcontainsomeofthesameobjects.Thisoverlap,whichiswhereidenticalobjectsareinallinfosets,iscalledtheintersection,anditisthisintersectionthatresultsinthenewinfoset.

Forexample,youhavetwocustodians,eachwithasignificantamountofdata,someofwhichisshared.Youwouldliketoascertainwhichoftheshareddataobjectsareidentical.Inthiscase,youwouldcreateanintersectioninfosetasyouwanttofindidentical,commondataobjectsbetweenthetwo.

Noticethatonlytheareaofsimilarity,thegrayintersectionbetweenthetwowhitecircles,isfoundinthenewinfoset.

SymmetricDifference

Asymmetricdifferenceinfosetcombinesaprimaryandselectedinfosetandremovesidenticalobjectsfromthem.Theremainingdataobjectsfrombothfilteredinfosetsthencombinetocreateanewinfoset.

Forexample,youagainhavetwocustodians,eachwithasignificantamountofshareddata.Youwouldliketoascertainwhichoftheshareddataobjectsarenotidentical.Inthiscase,youwouldcreateasymmetricdifferenceinfosetasyouwanttofinddataobjectsthataredifferentbetweenthetwo.

Noticethatonlytheareaofdifferencebetweenthetwoinfosetsisthewhiteintersection.Thisareaofdifferenceresultsinanewinfosetofeverythingbutthedatathatissharedbetweenthetwocircles.

Subtraction

Asubtractioninfosetcombinesaprimaryandselectedinfoset,removesidenticalobjects,andthensubtractstheremainingobjectsfromtheprimaryinfoset.Theremainderdataobjectsresultinthesubtractioninfoset.

Forexample,youhavetwoinfosets,bothofwhichcontainsimilarPSTsbyowner.Youwouldliketocombinebothinfosetsandretainonlytheuniquedataobjectstomakeanewinfoset.

Noticethatthetwoinfosetscombine,identicaldataobjectsareremoved,andonlytheremainingobjects,thatareaingray,createthenewinfoset.

IBMUnstructuredData751, p. 431

Page 441: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

thenewinfoset.Thistabledescribestheoptionsavailableforsetoperationsforeachinfoset.

Table2.AvailableoperationinfosetoptionsanddescriptionsAvailableOperation

InfosetOption Description

Name Thenameoftheinfosetagainstwhichasetoperationcanbeconducted.

TotalObjects Thetotalnumberofdataobjectsthatarecontainedwithintheinfoset.

InfosetSize Thesizeoftheinfoset.Composition Thecompositionoftheinfoset,toplevel,ormixedlevel.Created Thedateandtimeatwhichtheinfosetwascreated.

TypeThetypeofinfoset.Remember,setoperationscanbeconductedonlyagainstuserinfosets.SysteminfosetsarenotavailableintheAvailableOperationInfosetspane.

Search SearchforaparticularinfosetwiththeEnterterms...textboxandSearch.

DetailsClickDetailstoviewtheInfosetDetailswindow.Informationregardingtheinfoset'sname,description,totalnumberofobjects,numberofparentandchildobjects,size,composition,createddateandtime,type,andpercentageofexceptionsappears.

Note:Forunionandintersectionsetoperations,noticethatcheckboxesappeartotheleftoftheinfosetnamesbutthatforsymmetricdifferenceandsubtractionoperations,radiobuttonsappear.

CreatingaunioninfosetUnioninfosetsarethecombinationorjoiningintheirentiretyoftwoormoreinfosets.CreatinganintersectioninfosetIntersectedinfosetsaretheresultofthecombinationtwoormoreinfosetswhereidenticaldataobjectsarethenewinfoset.CreatinganinfosetwithasymmetricdifferenceSymmetricdifferenceinfosetsremoveidenticalobjectsfromtwofilteredinfosets.Theremainingdataobjectsfrombothfilteredinfosetsthencombinetocreateanewinfoset.CreatingasubtractioninfosetSubtractioninfosetsremoveobjectsthatarecontainedwithinthesecondaryinfosetfromtheprimaryinfoset.Theremainingobjectsthencreateasubtractioninfoset.

Parenttopic:Libraryofavailablefilters

RelatedconceptsLibraryofavailablefilters

IBMUnstructuredData751, p. 432

Page 442: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

CreatingaunioninfosetUnioninfosetsarethecombinationorjoiningintheirentiretyoftwoormoreinfosets.

Procedure1. Selecttheinfosettowhichyouwouldliketocombineoneormoreinfosets.Thisinfosetis

theprimaryinfoset.Note:Setoperationscanonlybeconductedonuserinfosets,notsysteminfosets.Thenameoftheprimaryinfosetappearswithintheinfosetwindow.

2. ClickCreate,andthenclickSetOperations.3. ClickUnion,andthenselectthecheckboxesoftheavailableinfosetstowhichyouwould

liketojointotheprimaryinfoset.Toselectalloftheavailableoperationinfosets,selectthecheckboxtotheleftofName.

4. ClickCreateNewInfoset.TheCreateNewInfosetdialogboxappears.5. IntheNewInfosetNametextbox,enterthewantednameofthisinfoset.6. IntheDescriptiontextbox,enterthewantednameofthisinfoset.7. ClickSelectoverlaysforthisinfosettodeterminewhichoverlaysaretobeappliedtothis

infoset.(Whenyouareexploringthisinfoset,theseselectedoverlaysareavailabletobeappliedwithintheDataMap.)

8. Toreceiveanemailaftertheinfosetiscreated,selectEmailmewhentheprocessiscompletecheckboxandentertheemailaddressatwhichyouwouldliketobenotified.

9. ClickSaveandViewtowatchtheinfosetcreate,orclickSave.

Parenttopic:Setoperations

RelatedconceptsSetoperations

IBMUnstructuredData751, p. 433

Page 443: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

CreatinganintersectioninfosetIntersectedinfosetsaretheresultofthecombinationtwoormoreinfosetswhereidenticaldataobjectsarethenewinfoset.

Procedure1. Selecttheinfosettowhichyouwanttocombineoneormoreinfosets.Thisinfosetisthe

primaryinfoset.Note:Setoperationscanonlybeconductedonuserinfosets,notsysteminfosets.Thenameoftheprimaryinfosetappearswithintheinfosetwindow.

2. ClickCreate,andthenclickSetOperations.3. ClickIntersection,andthenselectthecheckboxesoftheavailableinfosetsinwhichyou

wouldliketofindidenticaldataobjects.Dataobjectsthatarethesameineachoftheselectedinfosetsarethenusedtoformanew,intersectioninfoset.Toselectalloftheavailableoperationinfosets,selectthecheckboxtotheleftofName.

4. ClickCreateNewInfoset.TheCreateNewInfosetdialogboxappears.5. IntheNewInfosetNametextbox,enterthewantednameofthisinfoset.6. IntheDescriptiontextbox,enterthewantednameofthisinfoset.7. ClickSelectoverlaysforthisinfosettodeterminewhichoverlaysaretobeappliedtothis

infoset.(Whenyouareexploringthisinfoset,theseselectedoverlaysareavailabletobeappliedwithintheDataMap.)

8. Toreceiveanemailaftertheinfosetiscreated,selectEmailmewhentheprocessiscompletecheckboxandentertheemailaddressatwhichyouwouldliketobenotified.

9. ClickSaveandViewtowatchtheinfosetcreate,orclickSave.

Parenttopic:Setoperations

RelatedconceptsSetoperations

IBMUnstructuredData751, p. 434

Page 444: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

CreatinganinfosetwithasymmetricdifferenceSymmetricdifferenceinfosetsremoveidenticalobjectsfromtwofilteredinfosets.Theremainingdataobjectsfrombothfilteredinfosetsthencombinetocreateanewinfoset.

Procedure1. Selecttheinfosetfromwhichyouwanttoremovethesymmetricdifferenceofanother

infoset.Thisinfosetistheprimaryinfoset.Note:Setoperationscanonlybeconductedonuserinfosets,notsysteminfosets.Thenameoftheprimaryinfosetappearswithintheinfosetwindow.

2. ClickCreate,andthenclickSetOperations.3. ClickSymmetricDifference,andthenselecttheinfosetinwhichyouwanttofind

identicaldataobjects.Dataobjectsthatarethesameintheprimaryandselectedinfosetareremoved,andtheremainingdataobjectsarethencombinedtoformthenewinfoset.

4. ClickCreateNewInfoset.TheCreateNewInfosetdialogboxappears.5. IntheNewInfosetNametextbox,enterthenameofthisinfoset.6. IntheDescriptiontextbox,enterthenameofthisinfoset.7. ClickSelectoverlaysforthisinfosettodeterminewhichoverlaysmustbeappliedtothis

infoset.Whenyouareexploringthisinfoset,theseselectedoverlaysareavailabletobeappliedwithintheDataMap.

8. Toreceiveanemailaftertheinfosetiscreated,selectEmailmewhentheprocessiscompletecheckboxandentertheemailaddressatwhichyouwanttobenotified.

9. ClickSaveandViewtowatchtheinfosetcreate,orclickSave.

Parenttopic:Setoperations

RelatedconceptsSetoperations

IBMUnstructuredData751, p. 435

Page 445: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

CreatingasubtractioninfosetSubtractioninfosetsremoveobjectsthatarecontainedwithinthesecondaryinfosetfromtheprimaryinfoset.Theremainingobjectsthencreateasubtractioninfoset.

Procedure1. Selectaninfoset.Thisinfosetistheprimaryinfoset.

Note:Setoperationscanonlybeconductedonuserinfosets,notsysteminfosets.Thenameoftheprimaryinfosetappearswithintheinfosetwindow.

2. ClickCreate,andthenclickSetOperations.3. ClickSubtraction,andthenselecttheinfosetthatyouwanttosubtractfromtheprimary

infoset.Dataobjectsthatarethesameintheprimaryandselectedinfosetareremoved,andtheremainingdataobjectsformthenewinfoset.

4. ClickCreateNewInfoset.TheCreateNewInfosetdialogboxappears.5. IntheNewInfosetNametextbox,enterthenameofthisinfoset.6. IntheDescriptiontextbox,enterthenameofthisinfoset.7. ClickSelectoverlaysforthisinfosettodeterminewhichoverlaysmustbeappliedtothis

infoset.Whenyouareexploringthisinfoset,theseselectedoverlaysareavailabletobeappliedwithintheDataMap.

8. Toreceiveanemailoncetheinfosetiscreated,selectEmailmewhentheprocessiscompletecheckboxandentertheemailaddressatwhichyouwanttobenotified.

9. ClickSaveandViewtowatchtheinfosetcreate,orclickSave.

Parenttopic:Setoperations

RelatedconceptsSetoperations

IBMUnstructuredData751, p. 436

Page 446: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ScopeoperationsContaineddata,suchasdatawithin.ZIP,.TAR,or.PSTfiles,ishierarchicalandcanhavemanydifferentrelationshipandconnections.Dependingonhowthatdataisviewed,thatdatacangiveadifferentperceptionthanwhatisrepresented.TheScopeOperationstabhelpsuserstounderstandmorefullywhatdataisrepresentedbydatasets.

Therearetwoactionsavailablewithinscopeoperations:

ExpandThisoperatorexpandsallofthefileswithinaninfoset.Anynestedhierarchiesorcontainedfilesareopened,expandingintoanewinfosetthatisapotentiallymoreaccuraterepresentationofthecontaineddata.Note:Ifthefileswithintheinfosetarenotcontainerfiles,thentheExpandoperatorhasnoeffect.

CollapseThisoperatorcollapsesorretractsalloftheopenedorexpandedfileswithinaninfoset.Itresultsinanew,smallerinfosetthatisapotentiallymoreaccuraterepresentationofthedata.Note:Ifthefileswithintheinfosetarenotcontainerfiles,thentheCollapseoperatorhasnoeffect.

ExpandingahierarchyWhenyouareusingscopeoperationstoexpandahierarchy,nestedhierarchiesandassociationssuchasmessagethreads,emailattachments,andcompressedarchivecontentsarenolongercompressed.Dataobjectcountslikelyeitherremainthesameorincrease.CollapsingahierarchyWhenyouareusingscopeoperationstocollapseahierarchy,nestedhierarchiesandassociationssuchasmessagethreads,emailattachments,andcompressedarchivecontentsarenolongerexpanded.Dataobjectcountscanpossiblyeitherremainthesameordecrease.

Parenttopic:Libraryofavailablefilters

RelatedconceptsLibraryofavailablefilters

IBMUnstructuredData751, p. 437

Page 447: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ExpandingahierarchyWhenyouareusingscopeoperationstoexpandahierarchy,nestedhierarchiesandassociationssuchasmessagethreads,emailattachments,andcompressedarchivecontentsarenolongercompressed.Dataobjectcountslikelyeitherremainthesameorincrease.

Procedure1. Selecttheinfosetinwhichyouwanttoexpandhierarchies.Thisinfosetistheprimary

infoset.Thenameoftheprimaryinfosetappearswithintheinfosetwindow.2. ClickCreate.3. ClickScopeOperations.4. ClickExpand.Nestedhierarchiesandassociationsareexpanded,anddataobjectcounts

likelyeitherremainthesameorincrease.5. ClickCreateNewInfoset.TheCreateNewInfosetdialogboxappears.6. IntheNewInfosetNametextbox,enterthenameofthisinfoset.7. IntheDescriptiontextbox,enterthenameofthisinfoset.8. ClickSelectoverlaysforthisinfosettodeterminewhichoverlaysmustbeappliedtothis

infoset.Whenyouareexploringthisinfoset,theseselectedoverlaysareavailabletobeappliedwithintheDataMap.

9. Toreceiveanemailaftertheinfosetiscreated,selectEmailmewhentheprocessiscompletecheckboxandentertheemailaddressatwhichyouwanttobenotified.

10. ClickSaveandViewtowatchtheinfosetcreate,orclickSave.11. Reviewandvalidatetheobjectswithinthenewinfosetasneeded.

Parenttopic:Scopeoperations

RelatedconceptsScopeoperations

IBMUnstructuredData751, p. 438

Page 448: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

CollapsingahierarchyWhenyouareusingscopeoperationstocollapseahierarchy,nestedhierarchiesandassociationssuchasmessagethreads,emailattachments,andcompressedarchivecontentsarenolongerexpanded.Dataobjectcountscanpossiblyeitherremainthesameordecrease.

Procedure1. Selecttheinfosetinwhichyouwanttocollapsehierarchies.Thisinfosetistheprimary

infoset.Thenameoftheprimaryinfosetappearswithintheinfosetwindow.2. ClickCreate.3. ClickScopeOperations.4. ClickCollapse.Nestedhierarchiesandassociationsarecollapsed,anddataobjectcounts

likelyeitherremainthesameordecrease.5. ClickCreateNewInfoset.TheCreateNewInfosetdialogboxappears.6. IntheNewInfosetNametextbox,enterthenameofthisinfoset.7. IntheDescriptiontextbox,enterthenameofthisinfoset.8. ClickSelectoverlaysforthisinfosettodeterminewhichoverlaysmustbeappliedtothis

infoset.Whenyouareexploringthisinfoset,theseselectedoverlaysareavailabletobeappliedwithintheDataMap.

9. Toreceiveanemailaftertheinfosetiscreated,selectEmailmewhentheprocessiscompletecheckboxandentertheemailaddressatwhichyouwanttobenotified.

10. ClickSaveandViewtowatchtheinfosetcreate,orclickSave.11. Reviewandvalidatetheobjectswithinthenewinfosetasneeded.

Parenttopic:Scopeoperations

RelatedconceptsScopeoperations

IBMUnstructuredData751, p. 439

Page 449: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

EnhancementstoinfosetTheEnhancetabprovidesyouwithavisuallayoutofavailableenhancements.EnhancementsarecreatedasmodelswithinIBM®StoredIQAdministrator.Whenanenhancementisappliedtoaninfoset,itupdatesthatinfoset'sindex.

Table1.EnhanceoptionsanddescriptionsEnhanceOption DescriptionName Thenameoftheenhancementthatcanbeappliedtoaninfoset.Type Theenhancement'stype.Currently,theonlyoptionisAuto-class.Description Anoptionaldescriptionoftheenhancement.

IntheEnhancementsDetailsarea,asummaryoftheselectedenhancementisdisplayed,includingtheenhancement'sname,description,anditslastusagedate.

RunninganenhancementEnhancementsareanotherwaytorefineordistillanexistinginfoset.Withinanenhancement,existingpatternsandrulesareusedtodefinethecriteriaforwhichtheenhancementiscomprised.Byapplyinganenhancementtoaninfoset,thesamecriteriathatmakeuptheenhancementisappliedtotheselectedinfoset,creatinganew,refinedinfoset.SearchingforaspecificenhancementWhenyouhavemultipleenhancementsfromwhichtochoose,youcansearchforaspecificenhancementinsteadofusingtheslidertomovethroughavailableoptions.

IBMUnstructuredData751, p. 440

Page 450: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

RunninganenhancementEnhancementsareanotherwaytorefineordistillanexistinginfoset.Withinanenhancement,existingpatternsandrulesareusedtodefinethecriteriaforwhichtheenhancementiscomprised.Byapplyinganenhancementtoaninfoset,thesamecriteriathatmakeuptheenhancementisappliedtotheselectedinfoset,creatinganew,refinedinfoset.

AboutthistaskNote:Enhancementssuchasanauto-classificationmodelmustbecreatedanddefinedwithinIBM®StoredIQAdministratorbyanadministrator.IfanenhancementisnotavailablewithinIBMStoredIQAdministrator,contacttheadministrator.

Torunanenhancement:

Procedure1. Selecttheinfosetthatyouwanttoenhance.2. ClickEnhance.3. Selecttheenhancementthatyouwanttoapplytotheselectedinfoset.4. ClickRunEnhancement.TheRunEnhancementConfirmationwindowappears.ClickRun

andVieworRuntoruntheenhancement.

Parenttopic:Enhancementstoinfoset

RelatedconceptsEnhancementstoinfoset

IBMUnstructuredData751, p. 441

Page 451: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

SearchingforaspecificenhancementWhenyouhavemultipleenhancementsfromwhichtochoose,youcansearchforaspecificenhancementinsteadofusingtheslidertomovethroughavailableoptions.

Procedure1. Selecttheinfosetthatyouwanttoenhance.Theselectedinfosetappearsatthetopof

theinfosetwindow.2. ClickEnhance.3. IntheEnterkeyterms...textbox,enterthenameoftheenhancementsforwhichyou

wanttosearch,andthenpressSearch.Youcanentereitherthefullenhancementnameoraportionofit.Toremovethesearchterm,clicktheXtotheleftoftheEnterkeyterms....textbox.Enhancementsthatmatchtheenteredsearchtermarereturned.

4. Selecttheenhancement,andthenclickRunEnhancement.

Parenttopic:Enhancementstoinfoset

RelatedconceptsEnhancementstoinfoset

IBMUnstructuredData751, p. 442

Page 452: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ActionsondataActionsarepreconfiguredoptionsthathelpyoutomanagedataobjectsthatarecontainedwithininfosets.

Note:ActionsmustbecreatedanddefinedwithinIBM®StoredIQAdministratorbytheadministrator.Theycanbescheduledtorunimmediatelyoratalatertimeanddate.IfanactionisnotavailablewithinIBMStoredIQDataWorkbench,contactyouradministrator.WithinIBMStoredIQDataWorkbench,youcanperformtheseactionsondataobjectswithininfosets:

BasicMoveAmoveactionmovesdataobjectsfromonelocationtoanother.Whenyouaremovinganobject,thedesignatedlocationmustbespecified.

BasicCopyAcopyactioncopiesdataobjectsfromasourcevolumetoadestinationvolume.

RetentionCopyThisactioncopiesdataobjectsfromasourcetoaretentionlocationforaspecifiedretentionperiod.

DiscoveryExportThisactioncopiesdataobjectsandgeneratesfilesforloadingintothird-partylegalreviewtools.

DeleteThisactionremovesdataobjectsfromthesourcevolumes.

WithintheModifyAttributepolicy,theseoptionsareavailablewithinthepolicy:

Setread-onlySetstheread-onlybitonfilesinaninfosetforCIFSandNFSdatasources.

Setread/writeSetstheread/writebitonfilesinaninfosetforCIFSandNFSdatasources.

Note:Formoreinformationandassistanceinusingactions,contactyouradministrator.

SearchingforaspecificactionWhenyouhavemultipleactionsavailabletochoose,youcansearchforaspecificactioninsteadofusingtheslidertomovethroughavailableoptions.SchedulingandrunninganactionFromtheActionstab,actionscanbescheduledtorunimmediatelyoratapredeterminedschedule,providingyouwithgreaterflexibilityandcontroloveryourdata.CancelingascheduledactionScheduledorqueuedactions'executionscanbecanceledbeforetheyrun.

IBMUnstructuredData751, p. 443

Page 453: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

SearchingforaspecificactionWhenyouhavemultipleactionsavailabletochoose,youcansearchforaspecificactioninsteadofusingtheslidertomovethroughavailableoptions.

Procedure1. Selecttheinfosetonwhichyouwanttoact.Theselectedinfosetappearsatthetopofthe

infosetwindow.2. ClickAct.3. IntheEnterkeyterms...textbox,enterthenameoftheactionforwhichyouwantto

search,andthenpressSearch.Youcanentereitherthefullactionnameoraportionofit.Toremovethesearchterm,clicktheXtotheleftoftheEnterkeyterms....textbox.Actionsthatmatchtheenteredsearchtermarereturned.

4. Clicktheactionthatyouwanttoselect,andthenclickRun.

Parenttopic:Actionsondata

RelatedconceptsActionsondata

IBMUnstructuredData751, p. 444

Page 454: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

SchedulingandrunninganactionFromtheActionstab,actionscanbescheduledtorunimmediatelyoratapredeterminedschedule,providingyouwithgreaterflexibilityandcontroloveryourdata.

Procedure1. WithintheAvailableActionsarea,selecttheactionthatyouwanttoschedule,andthen

clickRunAction.TheActionSchedulingdialogboxappears.2. WithintheActionSchedulingdialogbox,youmustdetermineanactionschedule.Select

fromtheseoptions:Immediate:Ifyouselectthisoption,theactionisqueuedtorunimmediately.Scheduled:Ifyouselectthisoption,theactionisqueuedtorunaccordingtothescheduleyouset.IntheOntextbox,enterthedate,andintheattextbox,enterthetimethatthisactionisscheduledtorun.

3. Aftertheactionscheduleisset,clickRunandVieworRun.TheactioncanbeseenintheDetails>ExecutionLogtab.ActionsthatwerescheduledtorunimmediatelyshowasRunningintheTypecolumn.ActionsthatarescheduledtorunlaterarelistedasQueued.

Parenttopic:Actionsondata

RelatedconceptsActionsondata

IBMUnstructuredData751, p. 445

Page 455: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

CancelingascheduledactionScheduledorqueuedactions'executionscanbecanceledbeforetheyrun.

Procedure1. WithintheDetails>ExecutionLogtab,selecttheactionthatyouwanttocancel.Note:Inorderforanactiontobecanceled,itmustbescheduledorqueuedtorun.Youcannotcancelanactionthatisrunning.

2. IntheActionDetailsarea,clickCancelQueuedAction.TheCancelconfirmationwindowappears.

3. ClickOK.

Parenttopic:Actionsondata

RelatedconceptsActionsondata

IBMUnstructuredData751, p. 446

Page 456: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ExplorationofinfosetsanddataTheExploretabprovidesyouwithavisuallayoutofaninfoset.Ataglance,youcanseehowmuchdatayouhave,itstype,itsoverlays,anddetailedinformationaboutspecificdata.Byclickingwithinthedatamapitself,youcanexplorethedataandanalyzevariousdetails.

DatamapsTheIBM®StoredIQDataWorkbenchdatamapprovidesavisuallayoutofyourdatawhilegivingyouin-depthinformationregardingdatasourcetypes,datacategories,sizeoramounts,thenumberofdataobjects,andmoredetails.GroupinganinfosetbydatasourcetypeWhenyouareanalyzingwhatdatasourcetypesareusedtocompriseinfosets,youcanselectdatasourcetypestodisplayinthedataviewer.ViewingdatawithdifferentviewsObjectswithininfosetscanbeviewedbydifferentdataviews,rangingfromcategoryorsizetoitslastaccessedormodifieddate.SelectingadataoverlayDataoverlays,whichareconfiguredduringinfosetcreation,canbeappliedtoaninfoset.DownloadingCSVdataDataforaselectedtileofaninfosetcanbedownloadedascomma-separate-valuefiles.

IBMUnstructuredData751, p. 447

Page 457: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DatamapsTheIBM®StoredIQDataWorkbenchdatamapprovidesavisuallayoutofyourdatawhilegivingyouin-depthinformationregardingdatasourcetypes,datacategories,sizeoramounts,thenumberofdataobjects,andmoredetails.

Thedatamapcontainstheseareas.Table1.Datamaps

DataMapOption Description SeeAlso

GroupBy

TheGroupByareacontainstheseoptions:

DataSourceType:Thisviewdisplaysthedifferentdatasourcetypesthatmakeuptheselectedinfoset.Byselectingorclearingthedatasourcetypes,thedatamapautomaticallyreconfigures,providingyouwithavisualoverviewofyourdata.None:Thisoptionremovesdatasourcetypesfromthedatamap.

Formoreinformation,seeGroupinganInfosetbyDataSourceType.

ViewBy

TheViewByareacontainstheseoptions:

CategoryView:Youcanviewdatabycategory,includingcontainerfilesandarchives,images,spreadsheets,email,andsoon.SizeView:Youcanviewdatabysize,fromlessthan1MBtoover100GB.TheSizeViewisonlyactiveforinfosetsthathaveatop-levelcomposition.CreatedView:Youcanviewdatabycreateddatefromwithinthepast30daystomorethanfiveyearsago.LastModifiedView:Youcanviewdatabythelastmodifieddate,fromwithinthepast30daystomorethanfiveyearsago.LastAccessedView:Youcanviewdatabythelastaccesseddate,fromwithinthepast30daystomorethanfiveyearsago.

Byselectingorclearingtheviewingoptions,thedatamapautomaticallyreconfigures,providingyouwithavisualoverviewofyourdata.

Formoreinformation,seeViewingDatawithDifferentViews.

SelectDataOverlay

Dataoverlaysareavisualrepresentationofasavedfilter.Forexample,youmightcreatefiltersthatcanshowyouwhereobjectsthatcontaincredit-cardnumbers,SocialSecuritynumbers,orprohibitedwordscanbefoundwithinyoursystem.Note:Toapplyadataoverlay,youmustfirstcreateandsaveafilter.Formore

information,seeBuildingafilter.

Formoreinformation,seeSelectingaDataOverlay.

Withinthedatamap,youhavetheseviewing

IBMUnstructuredData751, p. 448

Page 458: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DataMap

Withinthedatamap,youhavetheseviewingoptions.

ObjectCount:Ifthisoptionisselected,thedatamapdisplaysthenumberofobjectsandtheirpercentageofthatdatasourcewhenyouplacethepointeroveracategory.ObjectSize:Ifthisoptionisselected,thedatamapdisplaysthesizeandpercentageoftheobjectsforthatdatasourcewhenyouplacethepointeroveracategory.ObjectSizeisonlyactiveforinfosetsthathaveatop-levelcomposition.

Youalsohavetheseviewingoptions:

Squarify:Thisviewdepictsdataasunorderedsquaresratherthanrectangles.Slice&Dice:Thisviewdepictsdataasorderedrectangles.Strip:Thisviewstripsdata,simplydepictingitintheeasiestviewingaspectpossible.

Formoreinformation,seeGroupinganInfosetbyDataSourceType.

DataMapDetails

Thisareadisplaysdetailsaboutatilethatisselectedinthedatamap.Byclickinganindividualmaptile,detailsaboutthatspecifictilearedisplayed.Youcanalsoseethetotalnumberofdataobjectsreferredtobythemaptile.WithintheDataMapDetails,youhavetheseviewingoptions:

Volumes:IftheVolumesoptionisselected,thevolume'snameandviewselecteddisplaysintheDataMapDetailsfortheselectedtile.Thebargraphpopulatesautomaticallybasedonthecountorsizeoftheselectedtile.Owners:IftheOwnersoptionisselected,theownersofcontentdisplayswithinthattilearedisplayedintheDataMapDetails.Thebargraphpopulatesautomaticallybasedonthecountorsizeoftheselectedtile.

Note:Selectedtileshaveagreenborder.Tilesoverwhichthepointerwasplacedhaveablackborder.

TheDataMapDetailsalsoshowsyoutheTotalSizeoftheselectedtile.Thebargraphautomaticallypopulates,providingavisualrepresentationofhowthesizeoftheselectedtilerelatestothatofthesizeoftheinfosetasawhole

ByclickingViewFullList,theDataMapDetailsdialogappears.Fromhere,youcandownloadinformationabouttheselectedtiletoaCSVfile.

IBMUnstructuredData751, p. 449

Page 459: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

toaCSVfile.

Viewingxofxtotalobject

Underthedatamap,thisfielddisplaysthefollowingoptions.

IfObjectCountisselected,thisfigureindicatesthenumberofdataobjectsthatarebeingviewedcomparedtothetotalnumberofdataobjects.IfObjectSizeisselected,thisfigureindicatesthedataobjects'sizeinbytescomparedtothetotalbytesizeofthedataobjects.

Note:SelectedoptionssuchasDataSourceType,ObjectCount,andSlice&Dicewithintheuserinterfaceareblue.

Parenttopic:Explorationofinfosetsanddata

RelatedconceptsExplorationofinfosetsanddata

IBMUnstructuredData751, p. 450

Page 460: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

GroupinganinfosetbydatasourcetypeWhenyouareanalyzingwhatdatasourcetypesareusedtocompriseinfosets,youcanselectdatasourcetypestodisplayinthedataviewer.

Procedure1. Selecttheinfosetforwhichyouwanttoexploreitsdata.Thenameoftheselectedinfoset

appearswithintheinfosetwindow.2. ClickExplore.Thedatamapappears,providingavisualoverviewofthedatawithinthe

selectedinfoset.3. Toviewtheselectedinfosetandthedifferentdatasourcesituses,clickDataSource

TypeintheGroupByarea.Toviewonlytheinfosetwithoutitstypesofdatasources,clickNone.AcompletelistingofthedifferentdatasourcetypesthatmakeuptheselectedinfosetappearswithintheGroupByarea.

4. Selectandclearthecheckboxestotheleftofthedatasourcetypes.Datasourcesthatareclearedareremovedfromthedatamap,andtheviewisautomaticallyreconfiguredtoreflectthedatasourcesthatareselectedorclearedwithintheGroupByarea.

5. Usethedatamaptobetterunderstandyourinfosetandthedatasourcesthatareusedtomakeupthatinfoset.

Parenttopic:Explorationofinfosetsanddata

RelatedconceptsExplorationofinfosetsanddata

IBMUnstructuredData751, p. 451

Page 461: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ViewingdatawithdifferentviewsObjectswithininfosetscanbeviewedbydifferentdataviews,rangingfromcategoryorsizetoitslastaccessedormodifieddate.

Procedure1. Selecttheinfosetforwhichyouwanttoexploreitsdata.Thenameoftheselectedinfoset

appearswithintheinfosetwindow.2. ClickExplore.Thedatamapappears,providingavisualoverviewofthedatawithinthe

selectedinfoset.3. ToviewtheselectedinfosetbyViewBycategories,selectoneofthesecategoriesinthe

list:CategoryView,SizeView,CreatedView,LastModifiedView,orLastAccessedView.Theinfosetisdisplayedwithinthedatamap,andthemaptilescorrespondtotheselectedviewtype.

Table1.ViewBySelectionOptionsViewByOption AvailableCategoryOptions

CategoryView

TheseoptionsareavailablewhenCategoryViewisselected:ContainerfilesandarchivesImagesSpreadsheetsMiscellaneousSystemfilesMultimediaComputerprogrammingWordprocessingPresentationEmailCollaboration

SizeView

TheseoptionsareavailablewhenSizeViewisselected:Lessthan1MB1MBto10MB10MBto100MB100MBto1GB1GBto10GB10GBto100GBOver100GB

Note:Thisoptionisonlyactivewhenyouareviewingatop-levelinfoset.

CreatedView

TheseoptionsareavailablewhenCreatedViewisselected:Last30days1-6monthsago6-12monthsago1-3yearsago3-5yearsagoOver5yearsago

LastModifiedView

TheseoptionsareavailablewhenLastModifiedViewisselected:Last30days1-6monthsago6-12monthsago1-3yearsago3-5yearsagoOver5yearsago

LastAccessedView

TheseoptionsareavailablewhenLastAccessedViewisselected:Last30days

1-6monthsago6-12monthsago1-3yearsago

IBMUnstructuredData751, p. 452

Page 462: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

1-3yearsago3-5yearsagoOver5yearsago

4. Selectandclearthecheckboxestotheleftoftheviewingoptions.Theviewingoptionsthatareclearedareremovedfromthedatamap,andtheviewisautomaticallyreconfiguredtoreflecttheoptionsthatwereselectedorclearedwithintheViewByarea.

5. Usethedatamaptobetterunderstandyourinfosetandthedatasourcesthatareusedtomakeupthatinfoset.

Parenttopic:Explorationofinfosetsanddata

RelatedconceptsExplorationofinfosetsanddata

IBMUnstructuredData751, p. 453

Page 463: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

SelectingadataoverlayDataoverlays,whichareconfiguredduringinfosetcreation,canbeappliedtoaninfoset.

Procedure1. Selecttheinfosetforwhichyouwanttoexploreitsdata.Thenameoftheselectedinfoset

appearswithintheinfosetwindow.2. ClickExplore.Thedatamapappears,providingavisualoverviewofthedatawithinthe

selectedinfoset.3. Selectthedataoverlaythatyouwanttoapplytotheinfoset.Formoreinformation,see

Creatinganoverlay.

Parenttopic:Explorationofinfosetsanddata

RelatedconceptsExplorationofinfosetsanddata

IBMUnstructuredData751, p. 454

Page 464: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DownloadingCSVdataDataforaselectedtileofaninfosetcanbedownloadedascomma-separate-valuefiles.

Procedure1. SelecttheinfosetforwhichyouwanttodownloadCSVdata.2. ClickExplore,andthenselectatileintheDataMap.3. InDataMapDetails,clickViewFullList.TheDataMapDetailsdialogboxappears.4. ClickDownloadtoCSV,andthenopenorsavetheCSVfileasneeded.

Parenttopic:Explorationofinfosetsanddata

RelatedconceptsExplorationofinfosetsanddata

IBMUnstructuredData751, p. 455

Page 465: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ExceptionsExceptionlistscontainvariousdataobjectssuchasfiles,emails,whichencounteredanerrorwhenanactionwasconductedontheinfoset.Thislisthelpsyoutoknowexactlywhatdataneedsattentionduetosomeerrororexception.Italsoservesasaninformationaltraceofwhatwentwrongduringtheprocess.

TheExceptionstabisdividedintothreeareas:Event,Types,andExceptionObjects.WhenyouselectanexceptionwithineithertheEventorTypesareas,contextualdetailsfortheselectedexceptionappearwithintheExceptionObjectsarea.

EventsTable1.Eventscolumndefinitions

EventsColumnHeading Definition

Name Thenameoftheexception.Started Thedateandtimeatwhichtheexceptionstarted.Type Theactiontype.

TypesTable2.Typescolumndefinitions

TypesColumnHeading Definition

NameThenameoftheexceptionthatwasappliedtothedataobjects.OptionsincludeExportError,FileAccessError,FileCopyError,NetworkError,Other,PermissionsError,ServerError,SystemError,orUnsupportedAction.

Severity Theseverityleveloftheexception.%ofInfoset Thepercentoftheinfosetwitherrors.Count Thenumberofdataobjectswithanerror.Size Thesizeofdataobjectswithanerror.

ExceptionobjectsTable3.Exceptionobjectscolumndefinitions

ExceptionObjectsColumnHeading Definition

Name Thenameoftheexceptionobject.Timestamp Thedateandtimeoftheexception.Event Therunactionthatresultedintheexception.Exception Thetypeofexceptionencountered.

MessageBasedontheexceptiontype,thismessageprovidesadditionalinformationabouttheexceptionitselfusinginformationthatispulledfromtheauditlog.

Filesize Theexceptionobject'sfilesize.

Filepath Thefilepathtotheexceptionobject'slocation.

RegardingStep-UpSnippets:TheExceptionstabdoesnotreportexceptionsforastep-upsnippet.Toseethoseexceptions,checktheharvestauditsonindividualdataservers.

Searchingforaspecificexceptionobject

IBMUnstructuredData751, p. 456

Page 466: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Whenyouhavemultipleexceptionobjectstochoose,youcansearchforaspecificexceptionobjectinsteadofusingtheslidertomovethroughavailableoptions.ViewingexceptionobjectdetailsTheExceptionObjectDetailsdialogboxdisplaysexceptiondetailsthatresultfromdifferentdataobjects.ExportingtheexceptionobjectslistUsethisproceduretoexportaCSVlistoftheexceptionobjectsthatarelistedintheExceptionObjectsarea.

IBMUnstructuredData751, p. 457

Page 467: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

SearchingforaspecificexceptionobjectWhenyouhavemultipleexceptionobjectstochoose,youcansearchforaspecificexceptionobjectinsteadofusingtheslidertomovethroughavailableoptions.

Procedure1. ClickExceptions.2. IntheEnterkeytermshere...textboxoftheExceptionsObjects,enterthenameofthe

exceptionobjectandthenpressSearch.Youcanentereitherthefullexceptionobjectnameoraportionofit.Toremovethesearchterm,clicktheXtotheleftoftheEnterkeyterms....textbox.Exceptionobjectsthatmatchtheenteredsearchtermarereturned.

3. Clicktheexceptionobjectthatyouwanttoselect.

Parenttopic:Exceptions

RelatedconceptsExceptions

IBMUnstructuredData751, p. 458

Page 468: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ViewingexceptionobjectdetailsTheExceptionObjectDetailsdialogboxdisplaysexceptiondetailsthatresultfromdifferentdataobjects.

Procedure1. Selecttheexceptionobjectsforwhichyouwanttoviewdetails.2. ClickViewDetails,andtheExceptionObjectDetailsdialogboxappears.Thisdialogbox

displaysdetailsaboutthedataobjectthatcausedtheexception.3. ClickNextorPrevioustoviewdifferentdataobjectsthatcausedtheexceptions.4. Afteryoufinishviewingexceptionobjectdetails,clickClose.

Parenttopic:Exceptions

RelatedconceptsExceptions

IBMUnstructuredData751, p. 459

Page 469: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ExportingtheexceptionobjectslistUsethisproceduretoexportaCSVlistoftheexceptionobjectsthatarelistedintheExceptionObjectsarea.

Procedure1. Selecttheevent,type,andexceptionobjectsthatyouwanttoexport.2. ClickExportExceptionObjectsList.TheExportExceptionsObjectListdialogbox

appears.3. TosendanextracopyoftheCSVfiletoanotherperson,selecttheAlsosendacopyto

thefollowingaddresscheckboxandentertheemailaddressinthetextbox.TheexceptionsobjectlistisexportedasaCSVfile,andalinktothelocationisemailed.

4. ClickOK.

Parenttopic:Exceptions

RelatedconceptsExceptions

IBMUnstructuredData751, p. 460

Page 470: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

FilterconditionreferenceandexpressionlanguageThisappendixprovidesin-depthinformationaboutfull-textandattributeconditionsandhowtousetheexpressionlanguage.

Full-textsyntaxThefull-texteditorsupportsfull-textsyntax.Full-textmacrosTheIBM®StoredIQPlatformfull-textfiltersupportsasetofpredefinedmacros.ExtendedASCIIcharactersExtendedASCIIcharactersarehandledseveraldifferentwaysinthefull-textfilter.Somearespecialcharacterswhileothersaretreatedasspaces.Somearetreatedaslettersthatdependonthespacesaroundthecharactersandtheconfiguredfull-textsettings.AttributeconditionreferenceThefollowingsectionexplainshowtotypeinareferencetoanattributecondition.SpecificationofattributeconditionsAttributes,entity,tag,orquerycanbedividedupinseveralways.TypeofobjecttomatchForanyattributecondition,youcanspecifywhatobjectthatconditionmustmatch.FilterconditionreferenceandexpressionlanguageThisappendixprovidesin-depthinformationaboutfull-textandattributeconditionsandhowtousetheexpressionlanguage.MultiplematchingvaluesforoperatorsYoucangivemultiplematchingvaluesthatusethefollowingoperators.At-leastexpressionsOnoccasion,itishelpfultospecifythatsomenumberofconditionsmustbetruebeforeanobjectisconsideredtomatch.Theseexpressionsarecalledat-leastexpressionsbecauseatleastXsubexpressionsmustmatchanobjectbeforetheobjectmatchestheoverallexpression.ParentandchildconditionsThisparentandchildconditionsrepresentadvancedfunctionthatmustbeundertakenonlybyexperiencedadministrators.No-inheritanceconditionsTheno-inheritanceconditionsrepresentadvancedfunctionthatmustbeundertakenonlybyexperiencedadministrators.AnalyticsfilterexpressionsTheanalyticsfilterexpressionsrepresentadvancedfunctionthatmustbeundertakenonlybyexperiencedadministrators.

Parenttopic:Filterconditionreferenceandexpressionlanguage

IBMUnstructuredData751, p. 461

Page 471: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Full-textsyntaxThefull-texteditorsupportsfull-textsyntax.

Thefull-textfeaturesupportsawiderangeoffull-textsyntaxtobroadenornarrowfilters.Aone-wordtermlikeSeptemberreturnsresultsfromallharvesteddataobjectsthatincludethetermintheircontent.Wordmatchingiscase-insensitive.Alistofwordsmatchanyofthosewords.Forexample,SeptemberOROctobermatchallobjectsthatcontaineitherSeptemberorOctober.

GroupingWhenyouareexaminingtext,IBM®evaluatestherequestedoperatorsandgivesprecedencetosomeoverothers.Theserulesaredescribedinthefollowinglist.

Note:Right-associativeandleft-associativemeansthatwhenparenthesesareusedtogroupoperators,theexpressioninparenthesesisgiventhehighestprecedence.Ifnoparenthesesareusedintheexpression,associativityrulesareusedinstead.Right-associativemeansthattheoperatorisgroupedinitiallywiththeoperandtoitsright.Left-associativemeansthattheoperators/operandstotheleftareevaluatedbeforetheoperators/operandstotheright.

1. NOT,right-associative."OctoberNOTNovemberORDecember"means"(OctoberAND(NOTNovember))ORDecember".

2. Proximityoperators("w/"and"pre/"),left-associative."Octoberw/3Novemberpre/5December"means"(Octoberw/3November)pre/5December".("October"and"November"mustbewithinthreewordsofeachother,butbothmustbebefore"December"bynomorethanfivewords.)"Octoberw/3NovemberandDecember"means"(Octoberw/3November)andDecember".

3. TheANDoperator,left-associative."OctoberANDNovemberORDecember"means"(OctoberANDNovember)ORDecember".

4. TheORoperatorornooperator,left-associative."OctoberNovemberORDecember"meansthesameas"(OctoberORNovember)ORDecember".

BooleanOperatorsThistablelistsBooleanoperatorsyntaxanddescriptions.

Table1.BooleanoperatorsyntaxItem Description

AND&&

Whenusedbetweentwoterms,theANDoperatorensuresthatbothtermsappearinthedataobject.Forexample,thefilterchairmanANDstockreturnsonlydataobjectswherechairmanandstockbothappear.Thedoubleampersand(&&)canbeusedinsteadoftheANDoperator.ANDcanbeuppercaseorlowercase.

OR||

Whenusedbetweentwoterms,theORoperatorreturnsdataobjectswhereeithertermappears.Forexample,thefilterchairmanORstockreturnsdataobjectsthathavechairman,stock,orbothinthedataobject.Thedoublepipe(||)canbeusedinsteadoftheORoperator.ORcanbeuppercaseorlowercase.

NOT!

Whenusedbeforeaterm,theNOToperatorensuresthatthefollowingtermdoesnotappearinanydataobjectsreturned.Forexample,AppleNOTIBMreturnsdataobjectswherewordAppleappears,butnotIBM.YoucanthinkoftheNOTitemas"andnot"or"butnot".Theexclamationpoint(!)canbeusedinsteadoftheNOToperator.NOTcanbeuppercaseorlowercase.

IBMUnstructuredData751, p. 462

Page 472: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

MultipleTermsorTermPhraseThistablelistsmultipletermsortermphrasesyntaxitemsanddescriptions.

Table2.TermsItem Description

""and*

Quotationmarksaroundatermphrasereturndataobjectsthathavethatphraseinorderinadataobject.Forexample,"September201998"returnsonlydataobjectswiththeexactphraseofSeptember201998.Doublequotationmarksallowforwildcardsintermswhereassinglequotationmarksdonot.Atermphrasehasthestopwordsremoved.Forphraseswithdoublequotationmarks,allwildcardcharactersinthephrasearematchedaswildcards.Forphraseswithsinglequotationmarks,thewordsaredividedonwhitespaceandfilteredforexactlyastheyareentered.Forexample,"stockANDoption*"returnsresultswithbothstockoptionandstockoptions.ThewordANDisignoredasastopword.

Multi-term,noBooleanoperators

AfilterforamultiplewordwithoutBooleanoperatorsorquotationmarksisanimpliedORfilter.Forexample,September201998returnsdataobjectsthathaveSeptemberOR20OR1998.Stopwordsareremoved.

Grouping

GroupingwithBooleanoperatorsandparenthesesallowsuserstonarrowresultsbyusingattributes.Forexample,($10ORbillion)ANDoptionsreturnsdataobjectswhere$10orbillionmightbeinthedataobject,butoptionsmustexist.Booleanoperators(AND,OR,NOT)workinagroupingorinaproximitygroup.So("SaharaDesert"AND"SoutheastAsia")OR("PacificOcean"AND"Bavaria")returnsdataobjectsthathaveSaharaDesertandSoutheastAsiaorPacificOceanandBavaria.

WildcardThistablelistswildcardsyntaxitemsanddescriptions.

Table3.WildcardItem Description

*(Asterisk)

Asingleasteriskfindsmultiplecharactersorlettersatbeginningofaterm.Anasteriskthatisplacedbeforeapartialwordfindstermsthatendwiththoseletters.Forexample,afilterfor*ololreturnsresultsforbetaxolol,carteolol,levobetaxolol,levobunolol,metipranolol,andtimolol.Anasteriskmatchesanynumberofcharactersinthemiddleofaterm.Anasteriskthatisplacedinthemiddleofatermfindstermsthathavethosecharactersoneithersideoftheasterisk.Forexample,te*treturnsresultsfortext,test,tent,andtempest.Anasteriskthatisplacedafterapartialwordfindstermsthatbeginwiththoselettersattheendofaterm.Forexample,afilterforap*returnsresultsforApple,April,applied,andapplication.Anasteriskalonefindsallobjects.

?

Thequestionmarkmatchesasinglecharacter.Forexample,compl?returnsresultsforcomplybutnotcompliesorcompliance.Afilterforap?findsape,butnotapple.Tofilterformorethanonecharacter,useaquestionmarkforeachletter,forexample,ap??e.

IBMUnstructuredData751, p. 463

Page 473: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

example,ap??e.

ProximityThistablelistsproximitysyntaxitemsanddescriptions.

Table4.ProximitysyntaxItem Description

w/x

Filteringusesthew/xsyntax(xrepresentsthenumberoftermsbetweenthetwoterms)tousetherelationshipbetweentermstogetmoretargetedresults.Atwo-termfilterwithonetermthatappearsatthebeginningofadataobjectandtheotherattheendmightnotbeasrelevantaswhenthetermsappearinthesameparagraphorsentence.Forexample,inanSECdataobject,chairmanw/15optionsisamorerelevantfilterthanchairmanANDoptionsappearinginthesamedataobjectthatmightbeseveralpageslong.w/0matchestermsthatarenexttoeachotherinanyorder.w/1matchesfortermswithonewordbetweenthem.Thetermscanappearinanyorderinthedocument.Groupingwithproximityallowsforevenmoretargetedresults.Forexample,("SaharaDesert""SoutheastAsia")w/5("PacificOcean"Bavaria)findseitherSaharaDesertorSoutheastAsiawithinfivetermsofPacificOceanorBavaria.Termscanhavewildcardsorphrases.

pre/x

Thepre/xsyntax(xrepresentsthenumberoftermsbetweenthetwoterms)enablesuserstofurthertargetproximityfiltersbydictatingwhichtermcomesbeforeanotherterminthedataobjectandhowfarbeforeitis.Forexample,chairmanpre/15optionsreturnsdataobjectswherechairmancomesupto15termsbeforeoptions.pre/0matchestermsthatarenexttoeachotherandinthesameorder.pre/1matchestermswithatmostonewordbetweenthemandinthesameorder.Termscanhavewildcardsorphrases.

Parenttopic:Filterconditionreferenceandexpressionlanguage

RelatedconceptsFilterconditionreferenceandexpressionlanguage

IBMUnstructuredData751, p. 464

Page 474: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Full-textmacrosTheIBM®StoredIQPlatformfull-textfiltersupportsasetofpredefinedmacros.

Amacroisanabbreviatedsetofinstructionsthatareusedincommonfilterpatterns.Forexample,thefilter{SSN}findsanydocumentthatcontainsSocialSecuritynumbers.

Full-textmacroshavethefollowingcharacteristics:

Amacroisanalphanumericnamethatisenclosedincurlybraces,forexample,{SSN}.Amacro'snameiscaseinsensitive.Forexample,themacro{ssn}isthesameasthemacro{SSN}.The{(leftcurlybrace)canhaveaspaceafterit.The},rightcurlybrace,canhaveaspacebeforeit.Forexample,{SSN}isthesameas{SSN}.Themacro'svalueisreplacedinthemacro'sfull-textquery.Then,thefilterisparsedandrun.Anyunrecognizedmacroresultsinasyntaxerror.Regularexpressions,thatisnamedcharacterclasses,donotmatchmacros.Thatis,aregularexpressionlike\p{Lower}(matchesanylowercaseASCIIcharacter)isnotrecognizedasamacro.

ThefollowingmacrosaredefinedwithinIBMStoredIQPlatform'sfull-textfeature.Eachofthesemacrosisahigh-confidencemacro.Itmeansthatthefilter{SSN}findsanydocumentthatcontainsSocialSecuritynumberswithhighconfidencethatthematchesreallyareSocialSecuritynumbers.TofindanythingthatmightbeaSocialSecuritynumber,usethelow-confidencemacro{SSN-lc}.

Macroscanbecombinedwithanyotherfull-textexpression,suchas{SSN}w/5"JohnDoe".

{SSN}:SocialSecuritynumbers,whichcanincludedashesandnumbers{USPhone}:USphonenumbers,whichcanincludedashes,dots,parentheses,numbers,andletters.Thismacrocanfilterformnemonicslike1-800-flowers.{InternetAddress}:LegalIPaddresses,eitherasnumbersorasnames,whichcanincludedots,numbers,andletters.{EmailAddress}:Legalemailaddresses,whichcaninclude@,dots,numbers,andletters.{CCAmex}:AmericanExpresscredit-cardnumbers,whichcanincludedashesandnumbers.{CCDiners}:DinersClubcredit-cardnumbers(includingenRoutecredit-cardnumbers),whichcanincludedashesandnumbers.{CCDiscover}:Discovercredit-cardnumbers,whichcanincludedashesandnumbers.{CCJCB}:JCBcredit-cardnumbers,whichcanincludedashesandnumbers.{CCMC}:MasterCardcredit-cardnumbers,whichcanincludedashesandnumbers.{CCVisa}:Visacredit-cardnumbers,whichcanincludedashesandnumbers.{CreditCard}:Anycredit-cardnumberfromthelistedproviders.

Parenttopic:Filterconditionreferenceandexpressionlanguage

RelatedconceptsFilterconditionreferenceandexpressionlanguage

IBMUnstructuredData751, p. 465

Page 475: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ExtendedASCIIcharactersExtendedASCIIcharactersarehandledseveraldifferentwaysinthefull-textfilter.Somearespecialcharacterswhileothersaretreatedasspaces.Somearetreatedaslettersthatdependonthespacesaroundthecharactersandtheconfiguredfull-textsettings.

Ifthefull-textsettingisconfiguredtoindexwithspecialcharactersorpunctuation,thosespecialcharactersorpunctuationmarksareindexedandcanbesearchedforinfilters.Ifthatcharacterisnotconfiguredunderthesettingthatismentionedinthepreviousbulletpoint,refertothefollowingtabletoseewhatbehaviorappliestothecharacter.

Table1.ExtendedASCIICharactersyntaxExtendedASCII

CharacterSyntax

Description

Specialcharacters

Somespecialcharactersgeneratesyntaxerrorsbecausetheycannotbeprocessed.Eitherremovethecharacterfromthefilterorsurroundthefilterwithsinglequotationmarks.Forexample,afilterforhello!withoutquotationsgeneratesanerror.However,ifthefilteris'hello?'(withsinglequotationmarks),thequerycanbeprocessed.Whetheryougetresultsthatmatchthetermdependsonthefull-textindexingsettingswithwhichthevolumewasharvested.

If!isonthelistofspecialcharactersthatareindexed,thenthefiltertreatsthe!asaletter,andthefilterfindsresultsforthedocumentsthatcontain!.If!isnotonthelistofspecialcharacters,thefiltertreats!asaspaceanddocumentsthatcontain!arenotfound.

Mostspecialcharacterscanalsobesearchedforwithquotationmarks.Forexample,"hello!"findshello!.Thedifferencebetweenquotationmarksandsinglequotationmarksisthatquotationmarksalsohaveanotherfunction:tofindwordsthatarenexttoonanother.Becauseofthis,specialcharactersthatareusedelsewhereinthesyntax,suchas*and?,aretreatedasthefull-textoperatorsforwildcardsinsteadofasthecharacters*and?.

Whenyouarefilteringforsinglequotationmarks,youcansurroundtheexpressionthatyouarefilteringforwithsinglequotationmarkstofindit.Forexample,ifyouconfiguredtheappliancetotreatquotationmarksasletters,youcanfilterfor"Joe's"tofindthewordJoe's.

Thesespecialcharactersgenerateerrorsunlesssurroundedbyquotationmarks:@-/&:!(){}[]^~:,#$%=_

Period(.)

Aperiodwithnospaceoneithersideistreatedlikealetter.Forexample,afilterfor172.16.0.46findsthewholenumberof172.16.0.46,notpartialnumbersof172,16,046.

Aperiodwithaspaceoneithersideistreatedasaspaceandignored.Forexample,afilterfor"1234MahanaSt."ignorestheperiodandjustfinds1234MahanaStonlywithoutaperiod.

At(@)An@symbolisindexedlikealetterwhentherearenospacesoneitherside.Forexample,[email protected]

address.An@symbolwithaspaceoneithersideoronesideistreatedasaspaceandignored.Forexample,@homefindshomeinthedataobject.

IBMUnstructuredData751, p. 466

Page 476: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Hyphen(-)Ahyphenisindexedlikealetterwhentherearenospacesoneitherside.Forexample,afilterfor012-44-5668findstheentirenumber,not012,44,5668asseparatenumbers.Ahyphenwithaspaceoneithersideistreatedasaspaceandignored,exceptwhenfollowedbynumerals,suchas"-1".

Slash(/)Aslashisindexedlikealetterwhentherearenospacesoneitherside.Forexample,afilterfor10/30/1940findstheentireexpression10/30/1940(andnot10301940)asseparatenumbers.

Ampersand(&)

Anampersandisindexedlikealetterwhentherearenospacesoneitherside.Forexample,afilterforS&PfindsS&Pinthedataobjects.However,afilterforProctor&GamblewithoutquotationmarksfindseitherProctororGamble.Afilterwithquotationmarks"Proctor&Gamble"findsthephraseProctorGambleonly.

Colon(:)Acolonisconsideredaspecialcharacter.Termswithcolonscanbefilteredeitherbysurroundingthetermwithsinglequotationmarks,'21:35:15'.Specifyingtermswithcolonswithoutthesinglequotationmarksresultsinaninvalidsyntaxerror.

Apostrophe(')

Theapostropheistreatedasaspacewhenitisapossessive.Forexample,afilterforpatient'sreturnsresultsforpatient.However,embeddedapostrophes,likeinthenameO'Hara,arenotconsideredaspaceandareindexedasawholeword.

Anapostropheistreatedasasinglequotationmark,soitmustalwaysbequotedwithdoublequotationmarks.

Comma(,)Commasareleftinwhensurroundedbynumerals,andthosenumeralsmakealegitimatenumber.Forexample,"1,000"isindexedas1,000,but"10,00"isindexedas10and00.Inallothercases,acommaistreatedasaspace.

Numbersign(#),Dollarsign($),Percent(%),Equalsign(=),Underscore(_)

Thesecharactersaretreatedaswhitespaceinthefilter.Forexample,asearchfor$100returnsresultsforthenumber100whether100referstodollars,apercentage,orawholenumber.

Parenttopic:Filterconditionreferenceandexpressionlanguage

RelatedconceptsFilterconditionreferenceandexpressionlanguage

IBMUnstructuredData751, p. 467

Page 477: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

AttributeconditionreferenceThefollowingsectionexplainshowtotypeinareferencetoanattributecondition.

Ifyoualwaysselectanattributefromthecustomfiltersoroneoftheattributegroups,xxxtakescareoftheattributereferenceforyou.Ifyoudonotselectanattributefromthecustomfiltersoroneoftheattributegroups,thenyouneedtoreviewandusethissection.

Atypedattributereferenceiscomposedofseveralparts:attribute-typepath/attribute-name.Theattribute-typegivesthespecifictypeofattributetowhichthepathandattribute-namerefer.Thisprefixisashortprefixoftheattributetype.Attributescanhaveduplicatenames,evenwithinonefolder.

Table1.AttributetypeprefixAttribute-type

Prefix Description

"att:"or“@” Thisprefixisasystem-definedattributeoruser-definedentity.

The"path"describesthefolderpathtotheattribute.Generally,itisoptional,butitisrequirediftheattributenamealoneisnotunique.Youdonotneedtotypethefullfolderpathtoanattribute.

Ifanattributenameorfolderpathnamehasspacesorpunctuationinit,thenyoumustenclosethenameindoubleorsinglequotationmarks.However,youdonotneedtoquotetheforwardslash('/')betweenfoldersorbeforetheattributename.Itisnotlegaltohavepartofanattributenamequoted;allofitmustbequoted.Youmustneverquotetheattributetypeprefix.

Parenttopic:Filterconditionreferenceandexpressionlanguage

RelatedconceptsFilterconditionreferenceandexpressionlanguage

IBMUnstructuredData751, p. 468

Page 478: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

SpecificationofattributeconditionsAttributes,entity,tag,orquerycanbedividedupinseveralways.

Whattypeofvaluesdoestheattributehave?Attributescanhavevaluesofnumber,string,enumeration,boolean,ordate.Anenumerationattributeisanattributethathasalimitedsetofpossiblevalues,whichareshowninalist.

Whenanattributeisacompoundattribute,eachofitssubattributesalsohasavaluetype:string,enumeration,boolean,ordate.Thesubattributescanalsobeeithersparseordense.Currently,allsubattributesaresingle-valued.Compoundattributescanalsobesparseordense.(Currentlyallcompoundattributesaresparse.)

Doallobjectshaveavalueforthisattribute?Iftheobjectsallhaveavalue,itisknownasadenseattribute.Iftheobjectsdonothaveavalue,itisknownasasparseattribute.AllobjectshaveanObjectnamevalue,soObjectnameisadenseattribute.OnlysomeobjectshaveaCCattributevalue,soCCisasparseattribute.Cananattributehavemultiplevalueswithinoneobject?Eachobjecthasonename,soObjectnameisasingle-valuedattribute.TheremightbemultipleTovaluesonanemail,soToisamultivaluedattribute.Compoundattributescanbesingle-valuedormultivalued.Acompoundattributeneverexistswhereallofitssubattributevaluesaremissing.

Theseconditionoperatorsareapplicabletoeachattributecategory.

Note:Forillustrationpurposes,someoperatorsareshowninuppercase,andsomeareshowninlowercase.Theparserrecognizesoperatorsineitheruppercaseorlowercase.

ConditionsforstringattributesTagsareconsideredsingle-valued,sparsestringattributes.Theyarenotconsideredenumerationattributes,eventhoughtheyhavealimitedsetofpossiblevalues.ConditionsforenumerationattributesSomeattributeshavealimitedsetofpredefinedvaluesthattheycanmatch,whicharecalledenumerationattributes.ConditionsfordateattributesTheconditionsfordateattributesarelistedasfollows.ConditionsfornumberattributesConditionsfornumberattributesarelistedasfollows.ConditionsforsparseattributesTheconditionsformultivaluedandsinglevaluedsparseattributesarelistedasfollows.ConditionsforcompoundattributesConditionsforcompoundattributesarelistedasfollows.ConditionsformultivaluedattributesConditionsformultivaluedsparseordenseattributesarelistedasfollows.AccessmodeattributeSpecifiesanattributethatcanbeusedinasearchexpressionforcreatinginfosetsthatarebasedoncertainfileattributesthatarecollectedduringharvests.

Parenttopic:Filterconditionreferenceandexpressionlanguage

RelatedconceptsFilterconditionreferenceandexpressionlanguage

IBMUnstructuredData751, p. 469

Page 479: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ConditionsforstringattributesTagsareconsideredsingle-valued,sparsestringattributes.Theyarenotconsideredenumerationattributes,eventhoughtheyhavealimitedsetofpossiblevalues.

attribute=valueorattributeisvalue

attribute!=valueorattributeisnotvalue

attributecontainsvalue

attributedoesnotcontainvalue

attributestartswithvalue

attributedoesnotstartwithvalue

attributeendswithvalue

attributedoesnotendwithvalue

attributematchesvalue

attributedoesnotmatchvalue

Thevaluecanbeasingleword,adouble-quotedstring,orasingle-quotedstring.Formatches,thevalueisaregularexpressionwithinquotationmarks.

Parenttopic:Specificationofattributeconditions

RelatedconceptsSpecificationofattributeconditions

IBMUnstructuredData751, p. 470

Page 480: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ConditionsforenumerationattributesSomeattributeshavealimitedsetofpredefinedvaluesthattheycanmatch,whicharecalledenumerationattributes.

Inthiscase,only'='and'!='operatorsaresupported.

attribute=valueorattributeisvalue

attribute!=valueorattributeisnotvalue

Alistofenumerationattributesisasfollows:

ContainertypeIs-part-ofBoxreasonEncryptiontypeSystemprocessingstateContentprocessingstateBinaryprocessingstateSystemerrorcodeContenterrorcodeBinaryerrorcodeMessagetypeLatestreviewstatusObjectcategory

Parenttopic:Specificationofattributeconditions

RelatedconceptsSpecificationofattributeconditions

IBMUnstructuredData751, p. 471

Page 481: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ConditionsfordateattributesTheconditionsfordateattributesarelistedasfollows.

attribute=valueorattributeisvalue

attribute!+valueorattributeisnotvalue

attribute<value

attribute<=value

attribute>value

attribute>=value

attributebetweenvalue1andvalue2

attributenotbetweenvalue1andvalue2

Thevaluecanhaveoneoftwoforms:anexplicitdateorarelativedatethatisoffsetfromtoday.

AnexplicitdateisintheformofYYYY-MM-DD,forexample,2009-03-08.

Otherdateformatsaresupported.Timeisnotsupported.Thedatesareallinterpretedasmidnightofthelisteddate.

Arelativedateoffsetisspecifiedasapositivenumber,followedbyarequireddateunits,andtheagooraheadkeyword.Theagokeywordisthedefaultandmeansadateinthepast.Theaheadkeywordmeansadateinthefuture.Forexample,3monthsago,3daysahead,or3weeksaheadarelegalrelativedates.Thealloweddateunitsareasfollows:

daysweeksmonthsyears

Thisfunctionisalsosupported:

-3days=3daysago+3weeks=3weeksaheadNote:Monthsareconsideredas30days;yearsareconsideredas365days.Normally,relativedateoffsetsareinthepast,butsomedatescanbeinthefuture,suchasaRetentionexpirationdate.Forthesereferences,usetheaheadkeywordinsteadofago.Relativedateoffsetscanalsobegivenasapositiveornegativenumber,suchas-3daysor+3monthswithouttheagooraheadkeyword.Inthiscase,negativenumbersareconsideredinthepastandpositivenumbersareconsideredinthefuture.

Parenttopic:Specificationofattributeconditions

RelatedconceptsSpecificationofattributeconditions

IBMUnstructuredData751, p. 472

Page 482: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ConditionsfornumberattributesConditionsfornumberattributesarelistedasfollows.

attribute=valueorattributeisvalue

attribute!=valueorattributeisnotvalue

attribute<value

attribute<=value

attribute>value

attribute>=value

attributebetweenvalue1andvalue2

attributenotbetweenvalue1andvalue2

Thevalueisapositiveornegativeinteger.Sizeattributes(SizeandSize(ondisk))cantakeanoptionalsizeunitafterthenumber.Theseamountsarethelegalsizeunits.

borbytesforsinglebyteskorkbforkilobytesmormbformegabytesgorgbforgigabyteskorkbforkilobytes

Note:Thedefaultsizeunitisbytes.Sizeunitsarebasedonmultiplesof1024,not1000.Eventdurationcanhavetimeunits.Thesetimeamountsarethelegalsizeunits:

morminutesforminuteshorhoursforhoursdordaysfordays

Parenttopic:Specificationofattributeconditions

RelatedconceptsSpecificationofattributeconditions

IBMUnstructuredData751, p. 473

Page 483: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ConditionsforsparseattributesTheconditionsformultivaluedandsinglevaluedsparseattributesarelistedasfollows.

attributeAPPEARSattributeNOTAPPEARSorattributeDOESNOTAPPEAR

Theseconditionsspecifywhethertheattributehasanyvaluesformatchingobjects.Inthiscase,itmeansthatoneofthesubattributeshasavalueonthisobject.Tagsareconsideredsingle-valued,sparsestringattributes.

Itisnotanerrortospecifytheseconditionsondenseattributes.However,ifyoudo,theparserwarnsyouthattheconditionisalwaystrueorfalse.Theseoperatorscanalsoapplytocompoundattributes.Inthiscase,itmeansthatoneofthesubattributeshasavalueonthisobject.Note:Asabackwardcompatiblemeasure,ifatt:attributeappearsisgivenonadense,booleanattribute,itisconvertedintoatt:attribute=true.Ifnotappearsisgiven,itisconvertedintoatt:attribute=false.

Parenttopic:Specificationofattributeconditions

RelatedconceptsSpecificationofattributeconditions

IBMUnstructuredData751, p. 474

Page 484: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ConditionsforcompoundattributesConditionsforcompoundattributesarelistedasfollows.

attributeWHERE<sub-attribute-condition>attributeWHERE(<sub-attributeexpression>)

A<sub-attribute-condition>isjustlikeanyoftheattributeconditionsthataredescribedexceptitisonasubattributeofthecompoundattribute.Additionally,a<sub-attribute-condition>canbejustthesubattributename.ItisequivalenttothesubattributeAPPEARS.

A<sub-attribute-expression>isanycombinationof<sub-attribute-condition>'scombinedwithAND,OR,orNOT.Thisexpressionmustbeenclosedinparentheses.The<sub-attribute-expression>canalsobeempty.Inthiscase,itisthesameasattributeAPPEARS.

ThisexampleusesWHEREexpressions:

att:"Siteowner(SharePoint)"WHEREname="JohnSmith"att:"Siteowner(SharePoint)"WHERE(name="JohnSmith"ANDurlAPPEARS)att:"Siteowner(SharePoint)"WHERE(name="JohnSmith"ORurlNOTAPPEARS)att:"Siteowner(SharePoint)"WHERE()

Note:Thisexpressionisthesameasatt:"Siteowner(SharePoint)"APPEARS.

att:"Siteowner(SharePoint)"WHERE(name)

Note:Thisexpressionisthesameasatt:"Siteowner(SharePoint)"WHEREnameAPPEARS.

Parenttopic:Specificationofattributeconditions

RelatedconceptsSpecificationofattributeconditions

IBMUnstructuredData751, p. 475

Page 485: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ConditionsformultivaluedattributesConditionsformultivaluedsparseordenseattributesarelistedasfollows.

attributeAPPEARSoperatornumber

attributeAPPEARSUNIQUEoperatornumber

Theseoperatorscanalsoapplytocompoundattributes,andtheoperatorcanbeoneofthefollowingoperators:

=>>=<<=

Theoperatornumberspecifiesaconditiononthenumberofvaluespresentfortheattributeonanymatchingobject.

Ifoperatornumberisnotgiven,then>0isassumed.IfUNIQUEisgiven,itspecifiesthenumberofuniquevaluespresentfortheattributeonanymatchingobject.

Itisnotanerrortospecifytheseconditionsonsingle-valuedattributes.However,ifyoudo,theparserwarnsyouthattheconditionisalwaystrueorfalse.

Parenttopic:Specificationofattributeconditions

RelatedconceptsSpecificationofattributeconditions

IBMUnstructuredData751, p. 476

Page 486: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

AccessmodeattributeSpecifiesanattributethatcanbeusedinasearchexpressionforcreatinginfosetsthatarebasedoncertainfileattributesthatarecollectedduringharvests.

Accessmodeattributesupportstheseoperators:APPEARS,NOTAPPEARS,andWHERE.

TheSubjectsubattributesupportstheseoperators:IS,ISNOT,=,!=,any(),andall().

TheReadableandWritablesubattributesbothsupporttheseoperators:IS,ISNOT,=,and!=.

Forexample,

Tofinddataobjectsforwhichyoucollectormaintaininformationaboutthereadorwritefilesystemflags,enteratt:"AccessMode"appears.Thissearchreturnseverysystem-levelobjectonCIFSorNFSvolumes.Tofinddataobjectsthatarewritablebyeitherofthethreetypesofsubjects,enteratt:"AccessMode"where(Subjectisany(Owner,Group,Others)andWritableisTrue)oratt:"AccessMode"where(WritableisFalse).Thesetwoexamplesaresemanticallyidentical.Ifyouthinkofther/w/xflagsasseparategroupsofflags(thatis,rwx|rwx|rwx),whereoneisfortheOwner,oneisfortheGroupthatausermightbeassociatedwith,andoneisforOthersinthatorder,thentheReadableorWritablesubattributesareevaluatedindependentlyforeachthreegroupofflags.

TheSubjectsubattribute(ifpresent)thenjustdefineswhichgroupoutofthethreemustbeconsideredorignored.The`lackoftheSubjectsubattributeindicatesthattheobjectsmustbeconsideredresponsivetotheexpressioniftheReadableorWritableconditions(oranycombinationofthem)evaluatetoTrueinANYofthethreegroups.

Tofinddataobjectsthatareread-onlybyeveryone,enteratt:"AccessMode"where(Subjectisall(Owner,Group,Others)andReadableisTrueandWritableisFalse).ThesubattributesareallANDedtogetherandtheSubjectsubattributelistseverypossibleoptionwiththeallqualifier.Tofinddataobjectsthatareread-onlybyatleastonetypeofsubject,enteratt:"AccessMode"where(Subjectisany(Owner,Group,Others)andReadableisTrueandWritableisFalse)oratt:"AccessMode"where(ReadableisTrueandWritableisFalse).Again,thetwoexampleshereproduceidenticalresultsforthesamereasonasexplainedinthepreviousbulletpoint.Tofinddataobjectsthatareread-onlybytheowner,enteratt:"AccessMode"where(Subject=OwnerandReadableisTrueandWritableisFalse).Youcareonlyabouttheownerinthiscase,soyouexplicitlycallOwnerandonlyOwnerout.Tofinddataobjectsthatownercaneitherreadorwrite(notnecessarilyboth),enteratt:"AccessMode"where(Subject=Ownerand(ReadableisTrueorWritableisTrue)).Tofinddataobjectsthatcanbewrittenbytheownerbutisread-onlybythegroup,enteratt:"AccessMode"where((Subject=OwnerandWritable=True)and(Subject=GroupandWritableisFalse)).

Parenttopic:Specificationofattributeconditions

RelatedconceptsSpecificationofattributeconditions

IBMUnstructuredData751, p. 477

Page 487: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

TypeofobjecttomatchForanyattributecondition,youcanspecifywhatobjectthatconditionmustmatch.

YoucanspecifyINobject-typeaftertheexpression.Forexample,inatt:Extension=doc=insystem,theobjectmustbeadocfileatthesystemlevel.Thecondition-scopecanbeanyoftheseobjecttypeshere.

Table1.AvailableobjecttypesAvailable

ObjectTypes Description

all Thematchingobjectcanbeanytypeofobject.Thisobjectisthedefault.

containerThematchingobjectmustbeacontainerobjectthatcanhaveotherobjectsnestedinsideit.File-archive,email-archive,email,calendar,contact,andtaskobjectsareincluded.

simple Thematchingobjectmustnotbeacontainerobject.system Thematchingobjectmustbeasystem-levelobject.contained Thematchingobjectmustbenestedwithinsomeothercontainerobject.

Onlyonecondition-scopecanapplytoanycondition.Ifyougivemultiplecondition-scopes,theparserissuesawarning.

Parenttopic:Filterconditionreferenceandexpressionlanguage

RelatedconceptsFilterconditionreferenceandexpressionlanguage

IBMUnstructuredData751, p. 478

Page 488: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

MultiplematchingvaluesforoperatorsYoucangivemultiplematchingvaluesthatusethefollowingoperators.

=!=containsnotcontainsmatchesnotmatchesstartswithnotstartswithendswithnotendswith

Tospecifymultiplematchingvaluesfortheseoperators,givethekeywordanyorallaftertheoperator,thenalistofvaluesinparentheses.Theanykeywordmeansthatanyofthevaluesareamatch.Theallkeywordmeansthatallthevaluesmustbepresent.Theallkeywordisonlymeaningfulformultivaluedattributes.Forexample:

Table1.KeywordexamplesExample Result

att:"Systemmetadata/Owner"=any(joe,bob,sally)

Ownercanbejoe,bob,orsally.

att:Size=any(1mb,2mb,1gb) Sizecanbe1mb,2mb,or1gb.att:"Modifieddate"=any(1weekago,2monthsago)att:"Accesseddate"=any(2009-09-19,2009-09-20,2009-09-21)att:To=all(joe,bob) "To"mustcontainbothjoeandbobForany,theoperatormustbetrueforatleastoneofthevalues.Itisasiftheuserspelledoutattributeoperval1ORattributeoperval2OR...

Forall,theoperatormustbetrueforallthevalues.Itisasiftheuserspelledoutattributeoperval1ANDattributeoperval2AND....FortheNOTvariousoperators,thissyntaxisthesameasusingNOTaroundtheentireexpressionandthecorrespondingpositiveoperator.Forexample,att:Size!=any(1mb,2mb,2gb)isthesameasNOT(att:Size=any(1mb,2mb,1gb)).TheNOTmatchesalldocumentsthatdonotmatchthepositiveoperator.Itisnotanerrortospecifyallonsingle-valuedattributes.However,ifyoudo,theparserwarnsyouthattheconditionisalwaysfalse.

Parenttopic:Filterconditionreferenceandexpressionlanguage

RelatedconceptsQueryexpressionlanguage

IBMUnstructuredData751, p. 479

Page 489: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

At-leastexpressionsOnoccasion,itishelpfultospecifythatsomenumberofconditionsmustbetruebeforeanobjectisconsideredtomatch.Theseexpressionsarecalledat-leastexpressionsbecauseatleastXsubexpressionsmustmatchanobjectbeforetheobjectmatchestheoverallexpression.

Thesyntaxforanat-leastexpressionistogivethekeywords"atleast"followedbyanumber,andthenbyalistofexpressionsinparentheses.Forexample:

atleast2(att:size=1mb,att:“systemmetadata/owner”=joe,att:"objectname"=foo.doc,att:"modifieddate">2009-03-28)

Thisexamplespecifiesthatatleasttwoofthefourconditionsmustbetruebeforeanyobjectisconsideredtomatchtheoverallexpression.

Eachsubexpressioninthelistcanbearbitrarilycomplex,butnormallytheyareonecondition.Eachsubexpressioninthelistmustbeseparatedfromtheotherswithacomma.

Parenttopic:Filterconditionreferenceandexpressionlanguage

RelatedconceptsQueryexpressionlanguage

IBMUnstructuredData751, p. 480

Page 490: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ParentandchildconditionsThisparentandchildconditionsrepresentadvancedfunctionthatmustbeundertakenonlybyexperiencedadministrators.

Youmightwanttofilterforobjectswhoseparentsorchildrenmatchcertainconditions.Forexample,findallemailstoJoeinasaved-emails.pstfileorfindemailstoJoethathaveanattachmentthatisnamedbig-contract.pdf.Tospecifythesekindsofqueries,givetheconditionsforthematchingobjectsasnormalandaddaprefixparentorchildtotheconditionsthatapplytotheparentorchildobjects.Herearetheexpressionsforthetwopreviousexamples:

att:"anyaddress"=Joeandparentatt:"objectname"="saved-emails.pst"

att:To=Joeandchildatt:"objectname"="big-contract.pdf"

Ifthereismorethanoneexpressionthatmustmatchtheparentorchildobjects,youmustputalltheconditionsinsideparentheses,forexample:

att:"anyaddress"=Joeandparent(att:"objectname"="saved-emails1.pst"oratt:"objectname"="saved-emails2.pst")

att:To=Joeandchild(att:"objectname"="big-contract.pdf"andatt:"modifieddate">2009-09-07)

Itisalsopossibletospecifyconditionsontheobjectlevelofparentorchildobjects.Anobjectlevelisthenestinglevelofanobject.System-levelobjectsareatlevelone,immediatelynestedobjectsareatleveltwo,andsoon.Forexample,ifyouwanttofindthenon-nestedemailstoJoeinsaved-emails.pst,youcando:

att:"anyaddress"=Joeandatt:"objectlevel"=2andparentatt:"objectname"="saved-emails.pst"

ItspecifiesthattheemailstoJoemustbeatobjectlevel2andbeinsidesaved-email.pst.

Itisalsopossibletospecifytheobjectleveloftheparentorchildobjectrelativetotheother.Forexample,tofindtheparentobjectofanyfilethatisnamednested-file.doc,youcanspecifyitthisway:

childatt:"objectname"="nested-file.doc"parent-level=child-level-1

Itmeansthatnested-file.doccanitselfbeatanylevel,andthequeryresultsarethedirectparentofthosefiles.

Thegeneralformofrelativeparent-childlevelconditionsislistedhere.

parent-leveloperatorchild-level+|-numberchild-leveloperatorparent-level+|-number

parent-leveloperatorchild-level+|-numberchild-leveloperatorparent-level+|-number

Plus(+)inthe+|-indicatesthattheparent-childmustbemoredeeplynestedthantheotherobjects.Minus(-)meanstheparent-childmustbelessdeeplynestedthantheotherobjects.

Theoperatorcanbeanyofthesecomparisons:NumericComparisonsforOperators

= != < <= > >=

Parenttopic:Filterconditionreferenceandexpressionlanguage

IBMUnstructuredData751, p. 481

Page 491: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

RelatedconceptsQueryexpressionlanguage

IBMUnstructuredData751, p. 482

Page 492: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

No-inheritanceconditionsTheno-inheritanceconditionsrepresentadvancedfunctionthatmustbeundertakenonlybyexperiencedadministrators.

Normally,thesearchengineallowssomeobjectstoinheritthevaluesoftheirparentobjects.Mostofthetimethisbehaviorisintuitive,buttherearetimeswhenthisbehaviormustbeturnedoff.Whenattributeinheritanceisnotwanted,prefixtheexpressionwithnoinheritance,andattributeinheritanceisturnedoffforthatexpression.Forexample,thisexpressionfindsemailstoJoecontainingstockoptioninthebodyoranyattachment:

att:To=joeand"stockoption"

However,ifyouwanttofindemailstoJoewithstockoptionintheemailbodyitself,thenyoumustturnoffinheritanceforthatpartoftheexpression:

noinheritance(att:To=joeand"stockoption")

Parenttopic:Filterconditionreferenceandexpressionlanguage

RelatedconceptsQueryexpressionlanguage

IBMUnstructuredData751, p. 483

Page 493: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

AnalyticsfilterexpressionsTheanalyticsfilterexpressionsrepresentadvancedfunctionthatmustbeundertakenonlybyexperiencedadministrators.

Queryanalyticsprovidesawaytofilterobjectswithcertainvaluesoutofthequeryresults.Thesefilterexpressionsarespecifiedaspartofthequeryexpression.Tospecifyfiltering,youspecifythe"filtered"keywordafterthequeryexpression.Forexample,query:Stock‐OptionMatterBoxJoefiltered.ItuseswhateverfiltersaresavedfortheStockOptionMatterBoxJoequery.TheStockOptionMatterBoxJoequerymusthaveanalyticsthatareassociatedwithit.

Itisalsopossibletoexactlyenumeratewhatfiltersmustbeappliedtoananalyticsquery.Youspecifythisquerybyspecifyingwhatdimensionvaluesmustbeincludedorexcluded.Hereisthegeneralform:

query:queryNamefilteredonincludedimension=value,excludealldimension=value,excludeuniquedimension=value...

Filterscomeinthreetypes:included(include),excluded(excludeall),orexcludedifthevaluesareunique(excludeunique).Ifnodimensionvalueisgivenforinclude,excludeall,orexcludeunique,thenthesavedfiltersofthattypeisused.Forexample,ifthequeryexpressionwerequery:queryNamefilteredonincludeatt:extension=doc,thenonlytheobjectswithextension=docisintheresults.Additionally,anyobjectsthatwereexplicitlyexcludedwithexclude-allorexclude-uniquearefilteredout.

Thevalueforadimension-valuecanalsobenoneorother.

Thenonekeywordmeansthoseobjectsthatdonothavethatdimension-value.Forexample,query:queryNamefilteredonincludetag:department=none.Thisquerywouldshowonlythoseobjectsthatdonothavesometag-valuefromdepartmentonthem.(Thiscaseisthesameastag:departmentnotappears.)Theotherkeywordmeansthoseobjectsthathavesomeothervaluethanwhatisshownintheanalyticsforthedimension.Analyticstypicallyshowthetop10-25valuesforanydimension.Ifyouwanttoseethoseobjectsthathaveavalueotherthanwhatisshownintheanalytics,youcanuseanexpressionlikequery:queryNamefilteredonincludeatt:extension=other.Itshowsthoseobjectswithanextensionthatisnotshownintheanalytics.

Parenttopic:Filterconditionreferenceandexpressionlanguage

RelatedconceptsQueryexpressionlanguage

IBMUnstructuredData751, p. 484

Page 494: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

IBMDiscoveryExportEDRMXMLIBM®EDRMXMLisbasedonthespecificationthatisdescribedintheEDRMXMLInterchangeFormatSchemaDocumentation,January23,2008.TheappendixdescribesthediscoveryexportfeatureforEDRMXML.

FilesystemdirectorylayoutThefollowingDiscoveryExportParametershaveasignificantimpactonthecontentoftheEDRMXMLrunexport.EDRMXMLconsiderationsToloaddatafromanIBMEDRMXMLrun,beginbyusingthesiq_loadfile_report.csvtolocatealltheloadfilessuccessfullyproducedinthecurrentrun.EDRMXMLmetadatatagsDescribesvaliddatatypesandEDRMXMLv1.0metadatatags.

IBMUnstructuredData751, p. 485

Page 495: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

FilesystemdirectorylayoutThefollowingDiscoveryExportParametershaveasignificantimpactonthecontentoftheEDRMXMLrunexport.

DestinationDirectoryLimitExportprocesstonumberofDataObjectsSaveatextcopy(thatisextractedfromdatafiles,otherwiseknownasplaintext)UniqueIDprefix,NumberofDigits,andPadZeros

SourcevolumefilesThefollowingexamplesarebasedonharvestingthesourcevolume\\qa01\grogers,startingwiththedirectoryhomeforoneoftwousers:flexus.

Parenttopic:IBMDiscoveryExportEDRMXML

RelatedconceptsIBMDiscoveryExportEDRMXML

IBMUnstructuredData751, p. 486

Page 496: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

SourcevolumefilesThefollowingexamplesarebasedonharvestingthesourcevolume\\qa01\grogers,startingwiththedirectoryhomeforoneoftwousers:flexus.

Althoughalldirectoriescannotbeseen,thislististhecompletelistofsourcevolumefilesanddirectories:

homehome/flexushome/flexus/backuphome/flexus/backup/carlota.ziphome/flexus/backup/Spaulding.dochome/flexus/carlota.ziphome/flexus/jbowers_identity.dochome/flexus/mybcchome/flexus/mybcc/to_jbowers.msghome/flexus/Spaulding.dochome/jbowershome/jbowers/Copyofidentity.dochome/jbowers/from_flexus.msghome/jbowers/identity.dochome/jbowers/philosophy.txthome/flexus.pst

Interestingfeaturesofthesourcedocumentsincludethefollowingfilesanddirectories:

Thefilehome/flexus/carlota.zipcontainstwotextfiles,friends.txtandenemies.txt.Thedirectoryhome/flexus/backupcontainscopiesoftwofilesthatarefoundinhome/flexus.home/flexus/mybcc/to_jbowers.msgcontainsasavedemailmessagethatflexussenttojbowers.ThatmessagehasacopyofSpaulding.docasanattachment.home/flexus.pstcontainstwoemails,onewithsubjectLetterfromSpauldingtolawyersandtheotherwiththesubjectPhilosophyofLife.Eachemailfurtherhasanattachment;theformerhastheattachmentSpaulding.doc,andthelatterhastheattachmentidentity.doc.home/jbowers/Copyofidentity.docisacopyofhome/jbowers/identity.doc.Thecontentsofbotharethesameashome/flexus/jbowers_identity.doc.home/jbowers/from_flexus.msgcontainsthesameemailmessageashome/flexus/mybcc/to_jbowers.msg.

EDRMXMLProductionprovidesexamplesthatillustratehowthediscoveryexportfeatureexportsfilesandmetadata.

EDRMXMLproductionThefollowingsectiondescribesthedetailsaboutthefilesthataregeneratedforanEDRMXMLdiscoveryexport.

Parenttopic:Filesystemdirectorylayout

RelatedconceptsFilesystemdirectorylayout

IBMUnstructuredData751, p. 487

Page 497: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

EDRMXMLproductionThefollowingsectiondescribesthedetailsaboutthefilesthataregeneratedforanEDRMXMLdiscoveryexport.

Note:Thediscoveryexportactionidentifiesduplicatefilesthatarebasedoncontent-baseddigestandonlyexportsonecopyofafileperdataserver.Theduplicatefilesareidentifiedintheaudittrail.

Aruncreatesdirectoriesandfilesonthediscoveryexportvolume.Allfilesforarunarelocatedunderadiscoveryexport-andrun-specificdirectoryonthedestinationvolumeunderthedestinationdirectory.

Foreachsubsequentrun,anewsubdirectoryiscreated.Thedirectoriesarenamedbytherunnumbers2,3,4,andsoon.

Anynumberofdiscoveryexportscanusethesameexportdirectory.Theoutputiskeptseparatebytheuseofthediscoveryexportname,suchascase_123,astheparentdirectorytotherundirectories.

Thisexampleconfigurationusesthefollowinginformation:

TargetVolume auto-P

DestinationDirectory exports

DocumentIDPrefix NS,numberofdigits6,with0padding

WhenadiscoveryexportpolicyisconfiguredtoexportEDRMXML,itexportstwotypesofoutputfiles:

NativeFiles:Copiesoforiginalsourcefilessuchasdoc,ppt,txt,and,optionally,plain-textversionsoftheoriginalsourcefiles.Thenativefilesarefoundinthedocumentssubdirectory.RunFiles:Filesthatcovertheentirerun.ThesefilesincludetheEDRMXMLrunsiqloadfile,theaudittrailxml,theEDRMtagdefinitionlist,acsvloadfilereport,andauser-ID-to-namecsvmappingfile.Thesefilesarefoundatthetopofthediscoveryexportrunsubdirectory.

Therundirectorycontainsthesefiles:

siq_audit_trail.xml:Theaudittrailforthediscoveryexportpolicyexecution.Itshowsthedetailsofeachsourceanddestinationobject.Essentially,itisanXMLencodingoftheinformationavailableusingtheIBM®StoredIQinterfacetotheaudittrail.siq_edrm_tag_definitions.csv:ThisfileisacsvfilethatlistsallthetagsintheEDRMXMLloadfilethatisproducedbyIBMStoredIQandrelatedinformation.ThefilehasthesamecontentsasthetableofmetadatatagsinEDRMXMLmetadatatags.siq_load_file-0-0.xml:ThisfileisaninstanceofanEDRMXMLloadfilethatisproducedintherun.

Note:Forperformancereasons,morethanoneinstanceofanEDRMXMLloadfilecanbeproducedduringasinglerun.

siq_loadfile_report.csv:Thiscsvfilelistsallloadfilesthatareproducedbytherunandstatusinformationthatstateswhethertheyarevalidforaloadornot.ThefilealsoreportstherangeofdocumentIDsproducedineachoftheloadfilesandothermetadatainformationsuchassizeanddatecreated.siq_userid_map:ThiscsvfilecontainsalistofuserIDscalleduidsintheNFSdomainandSIDintheWindowsSharedomainwithcorrespondingusernamesthatmaptotheuser

IBMUnstructuredData751, p. 488

Page 498: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

IDs.TheuserIDsandtheusernamescomefromtheproducednativefilesfortherun.

Underthedocumentssubdirectory,anintermediatedirectoryisnamed1thatcontainsthefiles.Toavoidputtingtoomanyfilesanddirectoriesinasinglesubdirectory,thefilesareplacedintonumberedsubdirectoriesthatcontainnomorethan10,000filesanddirectories.

InanEDRMXMLdiscoveryexport,containersarealwaysexpandedtoclearlyarticulatetheirinternalstructure.Adirectorystructureisbuiltwitheachlevelnamedafterthecontainerandanyintermediatecontainerstherein.Thepathtoadataobjectwithinthecontainerisachievedbyflatteningthestructureonthefilesystem.Youcanseethispathbylookingatthedirectorystructure.

Forinstance,inthisimage,thedataobjectsenemies-0.txtandfriends-1.txt,whicharecontainedwithinthecarlota.zipcontainer,areflattenedoutunderadirectorynamedcarlota.zip.members.Theircorrespondingplain-textfilesarenexttotheminthesamedirectory.

Plaintextfileisoptional,butwhenenabled,alldocumentshaveacorrespondingplain-textfile.Theplain-textfilesarenamedaccordingtotheirSHA-1hashvalueandsuffix,whichis.txt.

ThecompletelistoffilesanddirectoriesfortheEDRMXMLexportfortheexampleisasfollows:

//qa1/auto-P/exports/edrmglobal///qa1/auto-P/exports/edrmglobal/1///qa1/auto-P/exports/edrmglobal/1/documents//qa1/auto-P/exports/edrmglobal/1/documents/1//qa1/auto-P/exports/edrmglobal/1/documents/1/0x724b937d5a2750038325c8f4b48d1b5dcba77853.txt//qa1/auto-P/exports/edrmglobal/1/documents/1/0xf4dd8fe9b09c834a2033849ff8a5d63f67823787.txt//qa1/auto-P/exports/edrmglobal/1/documents/1/jbowers_identity.doc//qa1/auto-P/exports/edrmglobal/1/documents/1/Spaulding.doc//qa1/auto-P/exports/edrmglobal/1/documents/1/0x8d1e7cef561d7d81585af82d9f79f8a703bd96ee.txt//qa1/auto-P/exports/edrmglobal/1/documents/1/0xd7eb7675f2d201c79cf821debaaeba5a208cba29.txt//qa1/auto-P/exports/edrmglobal/1/documents/1/from_flexus.msg//qa1/auto-P/exports/edrmglobal/1/documents/1/philosophy.txt//qa1/auto-P/exports/edrmglobal/1/documents/1/carlota.zip.members//qa1/auto-P/exports/edrmglobal/1/documents/1/carlota.zip.members/0x22e2105930a1ddc75b9bc9dc3d5408c3b0bac8b1.txt//qa1/auto-P/exports/edrmglobal/1/documents/1/carlota.zip.members/0xfce44897add0b77c25fea85118fe47164dc828d4.txt//qa1/auto-P/exports/edrmglobal/1/documents/1/carlota.zip.members/enemies-0.txt//qa1/auto-P/exports/edrmglobal/1/documents/1/carlota.zip.members/friends-1.txt//qa1/auto-P/exports/edrmglobal/1/documents/1/from_flexus.msg.members//qa1/auto-P/exports/edrmglobal/1/documents/1/from_flexus.msg.members/0x1564f56aecf315cdecde563605fb151356f8dcc2.txt//qa1/auto-P/exports/edrmglobal/1/documents/1/from_flexus.msg.members/Spaulding-1.doc//qa1/auto-P/exports/edrmglobal/1/documents/1/flexus.pst.members//qa1/auto-P/exports/edrmglobal/1/documents/1/flexus.pst.members/TopofPersonalFolders.members///qa1/auto-P/exports/edrmglobal/1/documents/1/flexus.pst.members/TopofPersonalFolders.members/Story.members///qa1/auto-P/exports/edrmglobal/1/documents/1/flexus.pst.members/TopofPersonalFolders.members/Story.members/Production.members//qa1/auto-P/exports/edrmglobal/1/documents/1/flexus.pst.members/TopofPersonalFolders.members/Story.members/Production.members/flexus.members//qa1/auto-P/exports/edrmglobal/1/documents/1/flexus.pst.members/TopofPersonalFolders.members/Story.members/Production.members/flexus.members/0x277bab09a965f3840cd8a14300e0fccf59f6f5a9.txt//qa1/auto-P/exports/edrmglobal/1/documents/1/flexus.pst.members/TopofPersonalFolders.members/Story.members/Production.members/

IBMUnstructuredData751, p. 489

Page 499: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

flexus.members/PhilosophyofLife-7.msg//qa1/auto-P/exports/edrmglobal/1/documents/1/flexus.pst.members/TopofPersonalFolders.members/Story.members/Production.members/flexus.members/bcc.members///qa1/auto-P/exports/edrmglobal/1/documents/1/flexus.pst.members/TopofPersonalFolders.members/Story.members/Production.members/flexus.members/bcc.members/LetterfromSpauldingtohislawyers-9.msg//qa1/auto-P/exports/edrmglobal/1/documents/1/flexus.pst.members/TopofPersonalFolders.members/Story.members/Production.members/flexus.members/bcc.members/0x2a5bccfda550233ce9bac5d1f25e52590702a539.txt//qa1/auto-P/exports/edrmglobal/1/documents/1/flexus.pst.members/TopofPersonalFolders.members/Story.members/Production.members/flexus.members/bcc.members/.siq_overflow//qa1/auto-P/exports/edrmglobal/1/documents/1/flexus.pst.members/TopofPersonalFolders.members/Story.members/Production.members/flexus.members/bcc.members/.siq_overflow/0xd7eb7675f2d201c79cf821debaaeba5a208cba29.txt//qa1/auto-P/exports/edrmglobal/1/documents/1/flexus.pst.members/TopofPersonalFolders.members/Story.members/Production.members/flexus.members/bcc.members/.siq_overflow/Spaulding-8.doc//qa1/auto-P/exports/edrmglobal/1/documents/1/flexus.pst.members//qa1/auto-P/exports/edrmglobal/1/documents/1/flexus.pst.members/TopofPersonalFolders.members/Story.members/Production.members/flexus.members/PhilosophyofLife-7.mail.members//qa1/auto-P/exports/edrmglobal/1/documents/1/flexus.pst.members/TopofPersonalFolders.members/Story.members/Production.members/flexus.members/PhilosophyofLife-7.mail.members/0xf4dd8fe9b09c834a2033849ff8a5d63f67823787.txt//qa1/auto-P/exports/edrmglobal/1/documents/1/flexus.pst.members/TopofPersonalFolders.members/Story.members/Production.members/flexus.members/PhilosophyofLife-7.mail.members/identity-6.doc//qa1/auto-P/exports/edrmglobal/1/siq_audit_trail.xml//qa1/auto-P/exports/edrmglobal/1/siq_edrm_tag_definitions.csv//qa1/auto-P/exports/edrmglobal/1/siq_load_file-0-0.xml//qa1/auto-P/exports/edrmglobal/1/siq_loadfile_report.csv//qa1/auto-P/exports/edrmglobal/1/siq_userid_map.csv

Note:DuplicateFiles:Although20dataobjectswereoriginallyidentifiedforexport,only11nativefileswereeventuallyproduced,alongwithcorrespondingplaintextfiles.Duplicatesarenotcopiedandaremarkedinthepolicyaudittrail.TheEDRMXMLloadfilelistsalltheexporteddocumentsandrelatedmetadataaccordingtostandardEDRMspecifications.AnyexceptionsarenotedintheIBMStoredIQEDRMmetadatatagslist.

Parenttopic:Sourcevolumefiles

RelatedconceptsSourcevolumefiles

IBMUnstructuredData751, p. 490

Page 500: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

EDRMXMLconsiderationsToloaddatafromanIBM®EDRMXMLrun,beginbyusingthesiq_loadfile_report.csvtolocatealltheloadfilessuccessfullyproducedinthecurrentrun.

Loadthesefilesonebyone,preferablyintheorderofincreasingdocumentIDsmentionedinthereport,intothetargetapplication.Allfilereferencesineachoftheloadfilesarerelativetothelocationoftheloadfilesthemselves.Therefore,itisnecessarytoensurethatthisrelativelocationismaintainedforasuccessfulloadoperation.

TheEDRMXMLproducedineachloadfileiscompliantwiththeEDRMXMLVersion1.0XMLspecificationandcansuccessfullyvalidateagainsttheEDRMXMLValidationToolversion1.0.

XMLrootinformationThenameofthediscoveryexportisusedastheCaseIDthatdescribestheloadfileitself.Thediscoveryexportdescription,whichisenteredfromIBMStoredIQapplicationinterface,isalsopublishedintheDescriptionattribute.BatchinformationThebatchelementisassociatedwithasinglerunintheapplication.Bythisdefinition,thereisonlyonebatchelementineveryloadfileproduced.Thenameofthebatchistherunnumber.DocumententriesintheloadfileIntermediatearchivesinsidefilearchivesareonlypresentintheexportallmemberscaseoriftheseintermediatearchivesareresponsivetothequeryusedtodrivetherun.TaginformationInadditiontotheEDRMXMLstandardmetadatatags,thefollowinginformationisalsopresentintheloadfilesintheformofIBMStoredIQEDRMXMLtags.RelationshipbetweendocumentsTherelationshipsthataredescribedbetweendocumentsareasfollows.

Parenttopic:IBMDiscoveryExportEDRMXML

RelatedconceptsIBMDiscoveryExportEDRMXMLXMLrootinformationBatchinformationDocumententriesintheloadfileTaginformationRelationshipbetweendocuments

IBMUnstructuredData751, p. 491

Page 501: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

XMLrootinformationThenameofthediscoveryexportisusedastheCaseIDthatdescribestheloadfileitself.Thediscoveryexportdescription,whichisenteredfromIBM®StoredIQapplicationinterface,isalsopublishedintheDescriptionattribute.

Parenttopic:EDRMXMLconsiderations

RelatedconceptsEDRMXMLconsiderations

IBMUnstructuredData751, p. 492

Page 502: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

BatchinformationThebatchelementisassociatedwithasinglerunintheapplication.Bythisdefinition,thereisonlyonebatchelementineveryloadfileproduced.Thenameofthebatchistherunnumber.

Parenttopic:EDRMXMLconsiderations

RelatedconceptsEDRMXMLconsiderations

IBMUnstructuredData751, p. 493

Page 503: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DocumententriesintheloadfileIntermediatearchivesinsidefilearchivesareonlypresentintheexportallmemberscaseoriftheseintermediatearchivesareresponsivetothequeryusedtodrivetherun.

EmailarchivesareneverexpressedintheXMLasdocuments.OnlytheemailsthatareproducedfromtheseemailarchivesaredescribedintheXML.

Parenttopic:EDRMXMLconsiderations

RelatedconceptsEDRMXMLconsiderations

IBMUnstructuredData751, p. 494

Page 504: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

TaginformationInadditiontotheEDRMXMLstandardmetadatatags,thefollowinginformationisalsopresentintheloadfilesintheformofIBM®StoredIQEDRMXMLtags.

Taginformation Description

Responsive WhetherIBMStoredIQdeemedthedocumenttoberesponsiveornot,basedonthequerythatdrivesthepolicy.

Internalpath Pathleadingtotheobjectthatstartsfrombelowthefilesystemobject,ifitwascontainedwithinacontainer.InternetMessageID UniqueIDidentifyingeveryemail.

Parenttopic:EDRMXMLconsiderations

RelatedconceptsEDRMXMLconsiderations

IBMUnstructuredData751, p. 495

Page 505: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

RelationshipbetweendocumentsTherelationshipsthataredescribedbetweendocumentsareasfollows.

Attachment:Directattachmentstoanemailarerelatedtotheemail.Container:AmemberofafilearchiveisrelatedtoitsimmediateparentonlyiftheimmediateparentisexportedintheloadfileandhasaDocIDofitsown.Intheabsenceoftheimmediateparent,thememberisrelatedtothefilesystem-levelfilearchivethatisalwayspresentintheloadfile.

Ifanemailhasarchivesorotheremailsthatareattachedtoit,themembersofthearchivesoremailsarenotrelatedtothetopemail.Instead,theyarerelatedtothearchivesoremailstowhichtheydirectlybelong.

Thereisnocontainerrelationshipbetweenanemailinanemailarchiveandtheemailarchiveitselfbecausetheemailarchiveisnotproducedasadocumentintheloadfile.

Parenttopic:EDRMXMLconsiderations

RelatedconceptsEDRMXMLconsiderations

IBMUnstructuredData751, p. 496

Page 506: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

EDRMXMLmetadatatagsDescribesvaliddatatypesandEDRMXMLv1.0metadatatags.

ThefollowingdatatypesarevalidforIBM®StoredIQEDRMXMLtags.Table1.ValiddatatypesforEDRMXMLTags

Type CommentText Text(255charactersorfewer)Integer 32-bitintegerDateTime YYYY-MM-DDThh:mm:ss.sTZDDecimal StandardfloatBoolean {True/False}LongInteger 64-bitintegerLongText Text(32,767charactersorfewer)EDRM-standardtagnamesareprefacedwitha#.IBMStoredIQproprietarynamesareprefacedwithanSIQ-.Incertaincases,IBMStoredIQalteredthedatatypesforsometagsfromwhatisprescribedintheoriginalEDRMXMLv1.0metadatatagslisttosupportalargerrangeofvalues.ItdoesnotviolateEDRMcompatibility.

Table2.EDRMdatatagsDocument

TypeMetadataProperty TagName EDRM

DataType DataType Description

All Language #Language Text Text

ThisdocumentistheISO639-1(two-character)primarylanguageofthedocument.Ifomitted,thenEnglish(EN)canbeassumed.

Responsive-ness

SIQ-Responsive-ness

N/A Boolean

ItindicateswhetherIBMStoredIQdeemedtheobjecttoberesponsiveforthediscoveryexportrun.

InternalPath

SIQ-InternalPath N/A LongText

Thispathisthepaththatleadstoanobjectcontainedinsideacontainer,relativetothefilesystem-levelcontainer.

URL(SharePoint) SIQ-SP-URL N/A LongText

Itrepresentsinformationabouttheserver-relativeURLforthespecifiedWindowsSharePointServicesobject.

Version(SharePoint)

SIQ-SP-Version N/A Decimal

ItrepresentstheversionstringthatisassociatedwiththeuserinterfaceofthespecifiedWindowsSharePointServicesobject.

Author(SharePoint) #Author N/A Text

ItrepresentsthespecifiedauthoroftheWindowsSharePointServicesobject.

Title(SharePoint) #Title N/A Text

ItrepresentsinformationabouttheoccupationaltitleofaspecifiedWindowsSharePoint

IBMUnstructuredData751, p. 497

Page 507: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

(SharePoint)WindowsSharePointServicescontactobject.

Checkedoutto(SharePoint)

SIQ-SP-Checked-OutTo

N/A Text

ItrepresentsthedesignateduserwhocheckedouttheWindowsSharePointServicesobjectbyusingversioncontrol.

Editor(SharePoint) SIQ-SP-Editor N/A Text

ThisinformationistheeditornameorinformationthatisassociatedwithapersonwhoisreferencedbyaWindowsSharePointServicescontactobject.

Approvalstatus(SharePoint)

SIQ-SP-ModerationStatus

N/A Text

ItprovidesinformationaboutthemoderationstatusofthespecifiedWindowsSharePointServicesobject,oneofApproved,Denied,Draft,Pending,orScheduled.

Contenttype(SharePoint)

SIQ-SP-ContentType N/A Text

ItisthecontenttypeofthespecifiedWindowsSharePointServicesobject.

Checkincomment(SharePoint)

SIQ-SP-Checkin-Comment

N/A LongText

ItisthecheckincommentsofthespecifiedWindowsSharePointServicesobject.

Publishinglevel(SharePoint)

SIQ-SP-Publishing-Level

N/A Text

Itistheversion-controlalertlevelinformationofthespecifiedWindowsSharePointServicesobject,oneofPublished,Draft,orCheckout.

Managedkeywords(SharePoint)

#Keywords N/A Text

ItdescribesallmanagedkeywordsthatareappliedtospecifiedWindowsSharePointServicesobject.Multiplekeywordsareseparatedintotheirindividualtags.

Description SIQ-SP-Description N/A LongText

ItprovidesalternativetextforspecifiedWindowsSharePointServicesobject.

Keywords(SharePoint) #Keywords N/A Text

ItisthekeywordsummaryofthespecifiedWindowsSharePointServicesobject.Multiplekeywordsareseparatedintotheirindividualtags.

Comments(SharePoint) #Comments N/A Text

ItprovidescommentsthatareassociatedwiththespecifiedWindows

SharePointServicesobject.Multiplecommentsareseparated

IBMUnstructuredData751, p. 498

Page 508: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

commentsareseparatedintotheirindividualtags.

Virusstatus(SharePoint)

SIQ-SP-VirusStatus N/A Text

Itisthevirus-scanstatusofaspecifiedWindowsSharePointServicesobject:

CleanVirusreportedVirusreported;canberemovedViruspreviouslyreported;removedsinceVirusreported;cleanfailedVirusreported;deleterecommendedTimeoutlastprocessingforVirus

Declaredrecordtime(SharePoint)

SIQ-SP-DeclaredRecordDate

N/A DateTimeItisthedateatwhichtheitemwasdeclaredarecord.

Originalexpirationdate(SharePoint)

SIQ-SP-RecordExpiration-Date

N/A DateTimeItisthedateatwhichtheretentionontheobjectissettoexpire.

Routingruledescription(SharePoint)

SIQ-SP-Routing-Rule-Description

N/A LongTextThisdescriptionisassociatedwiththeobjectthatmatchedaroutingrule.

Litigationhold(SharePoint)

SIQ-SP-Litigation-Holds

N/A Text

Itisthelistofalllegalholdsplacedonanobject.Multiplelitigationholdsareseparatedintotheirindividualtags.

Recordrestrictions(SharePoint)

SIQ-SP-Record-Restrictions

N/A Text

DescribestherestrictionsthatareappliedtotherecordbythepoliciesintheRecordsCenter:

NoneBlockDeleteBlockEdit

Blogorlistname(SharePoint)

SIQ-SP-BlogOrListName

N/A TextItisthenameoftheblogorlisttowhichtheobjectbelongs.

Approvercomments(SharePoint)

SIQ-SP-ApproverComments

N/A LongText

ThesecommentsarethemoderationcommentsofthespecifiedWindowsSharePointServicesweblogobject.

SIQ-SP-

CUSTOM-AttributeName,where

Itprovidesallcustom

IBMUnstructuredData751, p. 499

Page 509: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Customproperties(SharePoint)

Name,whereAttribute-NameisthenameoftheCustomAttributewithwhitespacesreplacedby'_'

N/A LongText

ItprovidesallcustompropertiesthatareappliedtospecifiedWindowsSharePointServicesobject.

PostCategory(SharePoint)

#Category N/A Text

Thiscategoryisassociatedwiththepost.Categoriesaredefinedasmanagedobjectsontheblogsiteforusewithposts.

PublishedDate(SharePoint)

SIQ-SP-Published-Date

N/A DateTime Thedateonwhichthepostwaspublished.

PublishingContact(SharePoint)

SIQ-SP-PublishingContact

N/A Text Theusernameofthecontact.

WikiPageCategories(SharePoint)

#Category N/A Text

Theyarethemanagedmetadatavaluesthatdescribecategoriesforthewikipage.Multiplecategoriesareseparatedintotheirindividualtags.

PublishingContactEmail(SharePoint)

SIQ-SP-PublishingContact-Email

N/A Text Theemailaddressofthecontact.

WikiPageComment(SharePoint)

#Comments N/A LongTextThiscommentdescribestheWikipage.Therecanbeonlyone.

PublishingContactName(SharePoint)

SIQ-SP-Publishing-Contact-Name

N/A LongText Thefriendlynameofthecontact.

AverageRating(SharePoint)

SIQ-SP-Average-Rating

N/A DecimalTheaverageofallratingsthatareappliedtotheobject.

RatingCount(SharePoint)

SIQ-SP-Rating-Count N/A Integer

Thetotalnumberofratingsthatareappliedtothisobject.

MessageID(SharePoint)

SIQ-SPMessage-ID N/A Text

TheuniquemessageID(similartothoseonanemail)associatedwithapostonadiscussionboard.

DiscussionLastUpdated(SharePoint)

SIQ-SP-Discussion-Last-Updated

N/A DateTimeThetimestampforwhenthediscussionwaslastupdated.

ThreadIndex(SharePoint)

SIQ-SP-Thread-Index N/A LongText

Theuniqueindexintothediscussiontohelpdeterminethepositionofthepostinthethreadinghierarchyofthediscussion.Itidentifiesafieldthat

IBMUnstructuredData751, p. 500

Page 510: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

StatusBar(SharePoint)

SIQ-SP-StatusBar N/A DateTime

ItidentifiesafieldthatcontainsinformationaboutthestatusbarforaspecifiedSharePointFoundationobject.

DiscussionTitle(SharePoint)

SIQ-SP-Discussion-Title

N/A TextThetitleofthepostforwhichthereplywaswritten.

RecurrenceEvent(SharePoint)

SIQ-SP-Recurring-Event

N/A BooleanItindicateswhetheraneventisarecurringevent.

AllDayEventFlag(SharePoint)

SIQ-SP-AllDay-Event N/A Boolean

ItindicateswhethertheEventisanall-dayEventornot.

EventDate(SharePoint)

SIQ-SP-EventDate N/A DateTime Thestartdateforthe

event.EventLocation(SharePoint)

SIQ-SP-Event-Location N/A Text Thelocationforthe

event.

EventCategory(SharePoint)

#Category N/A TextThecategorythatisassociatedwiththeevent.

EventType(SharePoint)

SIQ-SP-EventType N/A Text

Theeventtype,whichhasoneofthefollowingvalues:

SingleEventRecurringEventDeletedRecurringEventEditedRecurringEvent

EventEndDate(SharePoint)

SIQ-SP-EventEnd-Date

N/A DateTime Theenddatefortheevent.

EventDuration(SharePoint)

SIQ-SP-Duration N/A Integer Thedurationinseconds

fortheevent.

TaskDueDate(SharePoint)

SIQ-SP-TaskDue-Date N/A DueTime Theduedateforatask.

AssignedTo(SharePoint)

SIQ-SP-TaskAssignedTo N/A Text Theusernametowhich

thetaskwasassigned.

TaskPriority(SharePoint)

SIQ-SP-TaskPriority N/A Text

Thepriorityofthetask,whichisusuallyoneof"(1)High,""(2)Normal,"or"(3)Low."TheAdministratorhastheoptionofeditingthechoices.

TaskStartDate(SharePoint)

SIQ-SP-TaskStart-Date N/A DateTime Thestartdateforatask.

Itiseitherthetaskstatusortheissuestatus.Theseoptionsfortaskstatus:

"NotStarted""InProgress""Completed"

IBMUnstructuredData751, p. 501

Page 511: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Status(SharePoint)

SIQ-SP-TaskOr-Issue-Status

N/A Text

"Completed""Deferred""Waitingonsomeoneelse"

Theseoptionsareforissuestatus:

"Active""Resolved""Closed"

Predecessors(SharePoint)

SIQ-SP-TaskPredecessors N/A Text

Thenamesoftasksthathaveadefinedprecedencetothetask.Multiplepredecessorsareseparatedintotheirindividualtags.

PercentComplete(SharePoint)

SIQ-SP-TaskPercentComplete

N/A IntegerThecompletionpercentageofthetaskasaninteger.

RelatedIssues(SharePoint)

SIQ-SP-Related-Issues N/A Text

Issuesthataremarkedasrelatedtoanissue.Multipleissuesareseparatedintotheirindividualtags.

IssueID(SharePoint)

SIQ-SP-IssueID N/A LongInteger TheuniqueIDforthe

issueinthelist.ContactFullName(SharePoint)

SIQ-SP-ContactFullName

N/A Text Thefullnameofthecontact.

WorkCountry(SharePoint)

SIQ-SP-Contact-Work-Country

N/A Text Thecountryofthecontact.

ContactWebPage(SharePoint)

SIQ-SP-ContactWebPage

N/A TextThewebpageURLofthecontactwithitsassociateddescription.

ContactEmail(SharePoint)

SIQ-SP-Contact-Email N/A Text Theemailaddressofthe

contact.

ContactJobTitle(SharePoint)

SIQ-SP-Contact-JobTitle

N/A Text Thejobtitleofthecontact.

WorkCity(SharePoint)

SIQ-SP-ContactWorkCity

N/A Text Thecityofthecontact.

ContactCompany(SharePoint)

#Company N/A Text Thecompanyofthecontact.

WorkZIP(SharePoint)

SIQ-SP-Contact-WorkZip

N/A Text Thepostalcodeofthecontact.

ContactFirstName(SharePoint)

SIQ-SP-Contact-FirstName

N/A Text Thegivennameofthecontact.

Contact

BusinessAddress(SharePoint)

SIQ-SP-Contact-Work-Address

N/A LongText Theworkaddressofthecontact.

IBMUnstructuredData751, p. 502

Page 512: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

(SharePoint)

WorkState(SharePoint)

SIQ-SP-Contact-WorkState

N/A Text Theworkstateofthecontact.

ContactBusinessPhone(SharePoint)

SIQ-SP-Contact-WorkPhone

N/A Text Theworkphoneofthecontact.

ContactHomePhone(SharePoint)

SIQ-SP-ContactHomePhone

N/A Text Thehomephoneofthecontact.

WorkFax(SharePoint)

SIQ-SP-Contact-WorkFax

N/A Text Theworkfaxnumberofthecontact

ContactMobilePhone(SharePoint)

SIQ-SP-Contact-Mobile-Phone

N/A Text Themobilenumberofthecontact.

Announce-mentExpiryDate(SharePoint)

SIQ-SP-Announce-ment-Expiry

N/A DateTimeTheexpirydatesetfortheannouncement,ifany.

SurveyCompleted(SharePoint)

SIQ-SP-SurveyCompleted

N/A BooleanItindicateswhetherthesurveyresponsewascompleted.

LinkURL(SharePoint)

SIQ-SP-LinkURL N/A LongText

TheURLthatformsthebasisofthelink,plusanoptionaldescription.Intheabsenceofthedescription,theURLisrepeated.

ProfileId(SharePoint)

SIQ-SP-User-ProfileId N/A Text Theuniqueidentifierfor

theuserprofile.Contactlastname(SharePoint)

SIQ-SP-UserLast-Name

N/A Text Thesurnameoftheuser.

PreferredName(SharePoint)

SIQ-SP-UserPreferredName

N/A Text Thepreferrednameoftheuser.

Department(SharePoint)

SIQ-SP-UserDepartment N/A Text Thedepartmentofthe

user.Manager(SharePoint)

SIQ-SP-User-Manager N/A Text Themanageroftheuser.

Username(SharePoint)

SIQ-SP-UserName N/A Text

TheusernamethatisassociatedwithaSharePointuserprofile.

Quicklinks(SharePoint)

SIQ-SP-UserQuicklinks

N/A Text

TheQuickLinksentrythatisconfiguredonauserprofile.Multiplelinksareseparatedintotheirindividualtags.

PublicURL(SharePoint)

SIQ-SP-UserProfile-PublicUrl

N/A LongText ThepublicURLtoaccessaSharePointuserprofile.

MemberOf(SharePoint)

SIQ-SP-UserMem-berOf

N/A Text

ItindicatesthesitesforwhichaSharePointUserisamember.Multiplesitesareseparatedintotheirindividualtags.

IBMUnstructuredData751, p. 503

Page 513: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

theirindividualtags.

Dotted-lineManager(SharePoint)

SIQ-SP-UserDottedLineManager

N/A Text Thedotted-linemanagerfortheuser.

Askmeabout(SharePoint)

SIQ-SP-UserAskMeAbout

N/A Text

ThequerytopicsforwhichaSharePointUserisopenoravailable.Multipletopicsareseparatedintotheirindividualtags.

OfficeCommunica-torAddress(SharePoint)

SIQ-SP-UserOffice-Communi-catorAddress

N/A Text Theofficecommunicatoraddressforuser.

HireDate(SharePoint)

SIQ-SP-UserHire-Date N/A DateTime Thehiredatefor

SharePointuser.Office(SharePoint)

SIQ-SP-UserOffice N/A Text Theofficeinformationfor

SharePointuser.OfficeLocation(SharePoint)

SIQ-SP-UserOfficeLocation

N/A TextTheoffice-locationinformationforSharePointuser.

Assistant(SharePoint)

SIQ-SP-UserAssistant N/A Text Theassistantforthe

user.

PastProjects(SharePoint)

SIQ-SP-UserPastProjects N/A Text

ThelistofpastprojectsthatareconductedbySharePointuser.Multipleprojectsareseparatedintotheirindividualtags.

Skills(SharePoint)

SIQ-SP-UserSkills N/A Text

TheskillsthatarelistedbySharePointuser.Multipleskillsareseparatedintotheirindividualtags.

Schools(SharePoint)

SIQ-SP-User-Schools N/A Text

TheschoolsthatarelistedbySharePointuser.Multipleschoolsareseparatedintotheirindividualtags.

Birthday(SharePoint)

SIQ-SP-UserBirthday N/A Text

ThebirthdateofSharePointuser(MM-DD).

StatusMessage(SharePoint)

SIQ-SP-UserStatusMessage N/A Text

ThemostrecentstatusmessageonSharePointuserprofile.

Interests(SharePoint)

SIQ-SP-UserInterests N/A Text

TheintereststhatarelistedbySharePointuser.Multipleinterestsareseparatedintotheirindividualtags.

Organization(SharePoint)

SIQ-SP-User-Organization N/A Text

TheorganizationtowhichtheSharePointuserbelongs.

Colleague(SharePoint)

SIQ-SP-UserColleague N/A Text

Thecolleaguesforauser.Multiplecolleaguesareseparatedintotheirindividualtags.Thesenderofthe

IBMUnstructuredData751, p. 504

Page 514: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Message From #From Text LongText

ThesenderofthemessageintheEDRM-recommendedRFC2821format(either"[email protected]"or"YourName<[email protected]>")Note:Emailaddressescanhave64-characteraccountnamesand255-characterdomainnames.

To #To Text LongText

Therecipientofthemessageinthesameformatas"From."Multiplerecipientsareseparatedintotheirindividualtags.

CC #CC Text LongText

Thecarbon-copiedrecipientofthemessageinthesameformatas"From."Multiplerecipientsareseparatedintotheirindividualtags.

BCC #BCC Text LongText

Theblindcarbon-copiedrecipientsofthemessageinthesameformatas"From."Multiplerecipientsareseparatedintotheirindividualtags.

Subject #Subject Text Text Thesubjectofthemessage.

FullEmailHeader #Header Text LongText

Themessageheaderofthemessage.Note:Theheadercanbelongerthan64,000characters;however,itistruncatedinthatcase.

SentDate #DateSent DateTime DateTime Thedatethemessagewassent.

ReceivedDate

#DateReceived DateTime DateTime Thedatethemessage

wasreceived.HasAttachments

#HasAttachments Boolean Boolean Itindicateswhetherthe

emailhasattachments.

AttachmentCount

#AttachmentCount Integer Integer

Thenumberofattachmentstheemailhas.

AttachmentNames

#AttachmentNames Text LongText

Theconcatenatedlistofattachmentnamesthatareseparatedbysemicolons.Note:Thelistofattachmentnamescanbelongerthan255characters.

ReadFlag #ReadFlag Boolean Boolean Itindicatesiftheemailwasread.

Importance#ImportanceFlag Boolean Boolean

Indicateswhetherthe

emailwassentwithhighimportance.

IBMUnstructuredData751, p. 505

Page 515: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

MessageClass

#Message-Class Text Text The(Outlook)message

class.FlagStatus #FlagStatus Text Text The(Outlook)flagstatus.

InternetMessageID

SIQ-InternetMessageID N/A Text

TheuniversalInternetmessageIDassignedtotheemail.Note:ThemessageIDisusuallyintheformunique_id@domain.

File FileName #FileName Text LongText

Thenameoftheoriginalfile.Note:Filenamescanbelongerthan255characters.

FileExtension

#File-Extension Text Text Theextensionofthe

originalfile.

FileSize #FileSize LongInteger LongInteger Thesizeoftheoriginalfileinbytes.

CreationTime

#Date-Created DateTime DateTime Thedatethefilewas

created.LastAccessedTime

#Date-Accessed DateTime DateTime Thedatethefilewaslast

accessed.

LastModifiedTime

#Date-Modified DateTime DateTime Thedatethefilewaslast

modified.

DateLastPrinted #Date-Printed DateTime DateTime Thedatethefilewaslast

printed.

Title #Title Text Text The(Office)documenttitle.

Subject #Subject Text Text The(Office)documentsubject.

Author #Author Text Text The(Office)documentauthor.

Company #Company Text Text The(Office)documentcompany.

Category #Category Text Text The(Office)documentcategory.

Keywords #Keywords Text LongText The(Office)documentkeywords.

Comments #Comments Text LongText

The(Office)documentcomments.Note:AllOfficedocumentmetadatacanbelongerthan255characters.

Parenttopic:IBMDiscoveryExportEDRMXML

RelatedconceptsIBMDiscoveryExportEDRMXML

IBMUnstructuredData751, p. 506

Page 516: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

MetadatabyattributetypeThisreferenceguidedescribesmetadatathatisorganizedbyattributetype.

Thecolumnheadingsintheattributetablesarelistedasfollows:Table1.Columnheadingsinattributetable

Name Nameoftheattribute.Dense DenseorSparse,signifyingwhetheranattributeoccursonanobject.

Multiple SingleorMultipleInstance,signifyingwhethertheattributecanoccurmultipletimes(Y)oronetime(N).

Type Indicateswhethertheattributeisastring,integer,Boolean,ordate.

NormalizedIndicateswhetherthepipelinehasanormalizationliabilitywhenyouareextractingtheattribute.Ingeneral,normalizingtheformatofanattributeproducesricherresults.

Description Providesadescriptionoftheattribute(optional).

SystemmetadataattributesThistabledescribessystemmetadataforWindowsShareandNFSattributes.DocumentumservermetadataattributesDocumentumattributesarelistedinthefollowingtable.CenteraservermetadataattributesMetadataforCenteraserverattributesislistedinthefollowingtable.DellDXObjectStoragePlatformmetadataattributesMetadataforDellDXObjectStoragePlatformattributesislistedinthefollowingtable.IBMInformationArchiveServermetadataattributesThistabledescribesmetadataforIBMInformationArchiveServerattributes.HitachiHCAPServermetadataattributesThistabledescribesmetadataforHitachiHCAPServersattributes.NetAppSnapLockServermetadataattributesThistabledescribesmetadataforNetAppSnapLockServerattributes.ExchangeServermetadataattributesThistabledescribesmetadataforExchangeServerattributes.DiscoveryAcceleratormetadataattributesThistabledescribesmetadataforDiscoveryAcceleratorattributes.FileNetmetadataattributesThistabledescribesmetadataforFileNetattributes.EmailmetadataattributesThistabledescribesmetadataforemailattributes.DataobjectpropertyattributesThistabledescribesDataObjectPropertyAttributes.Dataobjectpropertyattributesarestoredinsidethedataobject.SharePointattributesThistabledescribesSharePointmetadataattributes.CalendarmetadataattributesThistabledescribesmetadataattributesforcalendaritems.ContactmetadataattributesThistabledescribesmetadataattributesforcontacts.DigitalsignaturesmetadataattributesThistabledescribesattributesthatareusedinIBM®StoredIQdataanalysis.ProcessingmetadataattributesThistabledescribesattributesthatareusedindataprocessing.TaskmetadataattributesAttributevaluetypesThistabledescribesthevalueandinstance-basedexpressionsthatcanbeusedwithaquerycondition,dependingonthetypeofattribute.IBMLotusNotesmetadataattributesThistabledescribesmetadataforIBMLotusNotesattributes.EnterprisevaultmetadataattributesThistabledescribesmetadataforenterprisevaultattributes.

IBMUnstructuredData751, p. 507

Page 517: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

JivemetadataattributesThistabledescribesattributesthatareusedinJiveitems.ChattermetadataattributesThistabledescribesattributesthatareusedinChatteritems

IBMUnstructuredData751, p. 508

Page 518: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

SystemmetadataattributesThistabledescribessystemmetadataforWindowsShareandNFSattributes.

Table1.SystemmetadataattributesName Dense Multiple Type Normalized Description

AccessedDate Y N Date Y

Atimestampthatindicatesthelastaccessedtimeofthefile(YYYY-MM-DDhh:mm:ss)

Containerpath Y N String No

Pathofanobjectrelativetothecontaineritlivesin

Contenttypedescription Y N String No

Derivedfromthecontentofanobject;adescriptionoftheapplicationwithwhichtheobjectwascreated

Contenttypemismatch Y N Boolean No

Trueiftheobject'sextensiondoesnotmatchthecontenttypethatisderivedfromtheobject

CreatedDate Y N Date Y

Atimestampthatindicatesthecreationtimeofthefile(YYYY-MM-DDhh:mm:ss)

Dataobjecttype(isknown)

Y N Boolean N

Trueifthedatatypeoftheobjectcanbemappedtoaknownfileextensioninthesystem

Extension Y N String NTheextensionofthedataobjectThenameofthegroupownerofthefileasresolvedbyauserdirectoryservice.Ifthegroupidentifier

IBMUnstructuredData751, p. 509

Page 519: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Group Y N String N

identifiermightnotberesolved,perhapsbecausenodirectoryservicewasconfiguredoranerroroccurred,thefieldcontainsthestringrepresentationofthegroupID.

ModifiedDate Y N Date Y

Atimestampthatindicatesthelastmodifiedtimeofthefile(YYYY-MM-DDhh:mm:ss)

Objectcategory Y N String N Objectgeneral

filetype

ObjectID Y N String N

Nameofthedataobject(file)locatedwithinthecontextofthespecifiedvolume

Objectname Y N String N

Uniquedataobjectidentifierthatprovidesthedataobject's"handle"tothesystemwherethedataobjectresides.

Owner Y N String N

Theusernameofthefileownerasresolvedbyauserdirectoryservice.Iftheuseridentifiermightnotberesolved,perhapsbecausenodirectoryservicewasconfiguredoranerroroccurred,thefieldcontainsthestringrepresentationoftheuserID

IBMUnstructuredData751, p. 510

Page 520: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

oftheuserID

Owner(isknown) Y N Boolean N

Trueiftheobject'sownerattributecanbemappedtoaknownusernameinthesystem

Size Y N Int N Thesizeofthefileinbytes

Size(ondisk) Y N Int N

Theamountofphysicalclusterspaceadataobjectoccupies

Sourcecontainerpath Y N String N

Thecontainerpathoftheobjectonthesourcevolume

SourceVolume Y N String NTheoriginalprimarysourcelocation

SystemPath Y N String N

Allattributesthatreferencethedataobject'slocation

Parenttopic:Metadatabyattributetype

RelatedconceptsMetadatabyattributetype

IBMUnstructuredData751, p. 511

Page 521: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DocumentumservermetadataattributesDocumentumattributesarelistedinthefollowingtable.

Name Dense Multiple Type Normalized Description

ACLDomain

TherepositoryownernameorusernamethatcreatedtheAccessControlList

ACLName

NameuniquelyidentifyingtheAccessControlListontheDocumentumserver

Authors N N String N

Thecreatorofthedataobject,asshowninDocumentProperties.

Checkedoutto N N String N

Nameofpersonthedataobjectischeckedouttoforediting.

CreationDate Y N Date Y

Atimestampthatindicatesthecreationtimeofthefile.

FileSize Y N Int N Thesizeofthefileinbytes.

FormatApplicationtypeofthedataobject'scontent.

Group Y N String N

ThegroupnameofthefileownerasresolvedbyaDocumentumserver.

Immutable N N String N

Denoteswhetheradataobjectcanbechangeordeleted.

Keywords N N String NKeywordsthatareassociatedwiththedataobject.

LockDate Y N Date NDatethatmachinewas

locked(YYYY-MM-DD)

IBMUnstructuredData751, p. 512

Page 522: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

MM-DD)

LockMachine N N String N

Nameoftheclientmachineonwhichusersareworkingwhentheylockanobject(byacheckoutorbranchoperation).Iftheserverisunabletoresolvethename,r_lock_attributeissettotheclientmachine'sIPaddressinstead.

ModifiedDate Y N Date Y

Atimestampthatindicatesthemodificationtimeofthefile.

ObjectID Y N String N

Uniquedataobjectidentifierprovidesthedataobject's"handle"tothesystemwherethedataobjectisfound.

ObjectName Y N String N

Nameofthedataobject(file)locatedwithinthecontextofthespecifiedvolume.

Owner Y N String N

TheusernameofthefileownerasresolvedbyaDocumentumserver.

ParentdocumentID Y N String N Dataobject

parentIDParentdocumentname

Y N String N Dataobjectparentname

Retainuntil Y N Date N

Datedataobjectisreleasedfromretention.SetontheDocumentumservernotthroughtheapplication.

IBMUnstructuredData751, p. 513

Page 523: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

application.

Retentiondate Y N Date N

Datedataobjectwasplacedonhold.SetontheDocumentumservernotthroughtheapplication.

RPSmarkupname

RetentionPolicyServicesretentionpolicymarkupname

RPSpolicyname

RetentionPolicyServicesretentionpolicyname

Subject N N String N

Thesubjectofthedataobject.Bydefault,itisthesubjectoftheOfficedocumentasshowninDocumentProperties.Configurablebytheuserwhenitischeckedin.

Title N N String N

Thetitleofthedataobject.Bydefault,itisthetitleoftheOfficedocumentasshowninDocumentProperties.Configurablebytheuserwhenitischeckedin.

Version Y N String N

TheversionofthedataobjectfromaDocumentumserverperspective.

Note:AccessTimenotReset:WhenharvestingDocumentumvolumes,IBM®StoredIQdoesnotresettheaccesstimebacktotheoriginalvaluebeforetheharvest.Thereasonisduetoaknownissue.ResettingthevolumeaccesstimeonIBMStoredIQcausesDocumentumtoresetitsfiles'modificationtimeanddatetothetimeanddateoftheharvest.

Parenttopic:Metadatabyattributetype

Relatedconcepts

IBMUnstructuredData751, p. 514

Page 524: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Metadatabyattributetype

IBMUnstructuredData751, p. 515

Page 525: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

CenteraservermetadataattributesMetadataforCenteraserverattributesislistedinthefollowingtable.

Table1.MetadataforCenteraserverattributesName Dense Multiple Type Normalized Description

AccessDate Y N Date Y

Atimestampthatindicatesthelastaccessedtimeofthedataobject.

CreationDate Y N Date Y

Atimestampthatindicatesthecreationtimeofthedataobject.

FileExtension Y N String NThedataobject'sextension.

FileName Y N String N

Nameofthedataobjectlocatedwithinthecontextofthespecifiedvolume.

FilePath Y N String N

Allattributesthatreferencethedataobject'slocation.

FileSize Y N Int NThesizeofthedataobjectinbytes.

LitigationHold N Y String N

Nameofthelitigationholdthatisappliedtothedataobject.Therecanbemultiplelitigationholdsappliedtoadataobject.

ModifiedDate Y N Date Y

Atimestampthatindicatesthemodificationtimeofthedataobject.

ObjectID Y N String N

Uniquedataobjectidentifierprovidesthedataobject's

"handle"tothesystemwherethedataobject

IBMUnstructuredData751, p. 516

Page 526: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

thedataobjectisfound.

RetentionClass N N String N

Nameoftheretentionclassthatisappliedtothedataobject.

RetentionPeriod N N String N

Thelengthoftimeadataobjectissettoberetained.

RetentionPolicyName N N String N

Thenameofthepolicythatlastsetretentionforadataobject.

RetentionTag N N String N

Tagdefinedincopypolicythatisretainedinthecopiedandharvesteddataobject.

SourceVolume Y N String N

TheoriginatingserverandsharenamefromwhichanobjectwascopiedtoCentera.

Parenttopic:Metadatabyattributetype

RelatedconceptsMetadatabyattributetype

IBMUnstructuredData751, p. 517

Page 527: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DellDXObjectStoragePlatformmetadataattributesMetadataforDellDXObjectStoragePlatformattributesislistedinthefollowingtable.

Table1.MetadatafroDellDXObjectStoragePlatformattributesName Dense Multiple Type Normalized Description

AccessDate Y N Date Y

Atimestampthatindicatesthelastaccessedtimeofthedataobject.

CreationDate Y N Date Y

Atimestampthatindicatesthecreationtimeofthedataobject.

FileExtension Y N String NThedataobject'sextension.

FileName Y N String N

Nameofthedataobjectlocatedwithinthecontextofthespecifiedvolume.

FilePath Y N String N

Allattributesthatreferencethedataobject'slocation.

FileSize Y N Int NThesizeofthedataobjectinbytes.

LitigationHold N Y String N

Nameofthelitigationholdthatisappliedtothedataobject.Therecanbemultiplelitigationholdsappliedtoadataobject.

ModifiedDate Y N Date Y

Atimestampthatindicatesthemodificationtimeofthedataobject.

ObjectID Y N String N

Uniquedataobjectidentifierprovidesthedataobject's

"handle"tothesystemwherethedataobject

IBMUnstructuredData751, p. 518

Page 528: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

thedataobjectisfound.

RetentionPeriod N N String N

Thelengthoftimeadataobjectissettoberetained.

RetentionPolicyName N N String N

Thenameofthepolicythatlastsetretentionforadataobject.

RetentionTag N N String N

Tagdefinedincopypolicythatisretainedinthecopiedandharvesteddataobject.

SourceVolume Y N String N

TheoriginatingserverandsharenamefromwhichanobjectwascopiedtotheDellserver.

Parenttopic:Metadatabyattributetype

RelatedconceptsMetadatabyattributetype

IBMUnstructuredData751, p. 519

Page 529: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

IBMInformationArchiveServermetadataattributesThistabledescribesmetadataforIBMInformationArchiveServerattributes.

Table1.MetadataforIBMInformationArchiveServerName Dense Multiple Type Normalized Description

AccessDate Y N Date Y

Atimestampthatindicatesthelastaccessedtimeofthedataobject.

CreationDate Y N Date Y

Atimestampthatindicatesthecreationtimeofthedataobject.

FileExtension Y N String NThedataobject'sextension.

FileName Y N String N

Nameofthedataobjectlocatedwithinthecontextofthespecifiedvolume.

FilePath Y N String N

Allattributesthatreferencethedataobject'slocation.

FileSize Y N Int NThesizeofthedataobjectinbytes.

LitigationHold N Y String N

Nameofthelitigationholdthatisappliedtothedataobject.Therecanbemultiplelitigationholdsappliedtoadataobject.

ModifiedDate Y N Date Y

Atimestampthatindicatesthemodificationtimeofthedataobject.

ObjectID Y N String N

Uniquedataobjectidentifierprovidesthedataobject's

"handle"tothesystemwherethedataobject

IBMUnstructuredData751, p. 520

Page 530: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

thedataobjectresides.

RetentionClass N N String N

ThenameoftheIBMInformationArchivemanagementclassthatisboundtothedataobject.

RetentionPeriod N N String N

Thelengthoftimeadataobjectissettoberetained.

RetentionPolicyName N N String N

Thenameofthepolicythatlastsetretentionforadataobject.

SourceVolume Y N String N

TheoriginatingserverandsharenamefromwhichanobjectwascopiedtotheIBMInformationArchive.

Parenttopic:Metadatabyattributetype

RelatedconceptsMetadatabyattributetype

IBMUnstructuredData751, p. 521

Page 531: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

HitachiHCAPServermetadataattributesThistabledescribesmetadataforHitachiHCAPServersattributes.

Table1.MetadataforHitachiHCAPName Dense Multiple Type Normalized Description

AccessDate Y N Date Y

Atimestampthatindicatesthelastaccessedtimeofthedataobject.

CreationDate Y N Date Y

Atimestampthatindicatesthecreationtimeofthedataobject.

FileExtension Y N String NThedataobject'sextension.

FileName Y N String N

Nameofthedataobjectlocatedwithinthecontextofthespecifiedvolume.

FilePath Y N String N

Allattributesthatreferencethedataobject'slocation.

FileSize Y N Int NThesizeofthedataobjectinbytes.

LitigationHold N Y String N

Nameofthelitigationholdthatisappliedtothedataobject.Therecanbemultiplelitigationholdsappliedtoadataobject.

ModifiedDate Y N Date Y

Atimestampthatindicatesthemodificationtimeofthedataobject.

ObjectID Y N String N

Uniquedataobjectidentifierprovidesthedataobject'shandletothe

systemwherethedataobject

IBMUnstructuredData751, p. 522

Page 532: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

thedataobjectisfound.

RetentionPeriod N N String N

Thelengthoftimeadataobjectissettoberetained.

RetentionPolicyName N N String N

Thenameofthepolicythatlastsetretentionforadataobject.

SourceVolume Y N String N

TheoriginatingserverandsharenamefromwhichanobjectwascopiedtotheHitachiHCAP.

AccessDate Y N Date Y

Atimestampthatindicatesthelastaccessedtimeofthedataobject.

Parenttopic:Metadatabyattributetype

RelatedconceptsMetadatabyattributetype

IBMUnstructuredData751, p. 523

Page 533: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

NetAppSnapLockServermetadataattributesThistabledescribesmetadataforNetAppSnapLockServerattributes.

Table1.MetadataforNetAppSnapLockServerName Dense Multiple Type Normalized Description

AccessDate Y N Date Y

Atimestampthatindicatesthelastaccessedtimeofthedataobject.

CreationDate Y N Date Y

Atimestampthatindicatesthecreationtimeofthedataobject.

FileExtension Y N String NThedataobject'sextension.

FileName Y N String N

Nameofthedataobjectlocatedwithinthecontextofthespecifiedvolume.

FilePath Y N String N

Allattributesthatreferencethedataobject'slocation.

FileSize Y N Int NThesizeofthedataobjectinbytes.

LitigationHold N Y String N

Nameofthelitigationholdthatisappliedtothedataobject.Therecanbemultiplelitigationholdsappliedtoadataobject.

ModifiedDate Y N Date Y

Atimestampthatindicatesthemodificationtimeofthedataobject.

ObjectID Y N String N

Uniquedataobjectidentifierprovidesthedataobject's

"handle"tothesystemwherethedataobject

IBMUnstructuredData751, p. 524

Page 534: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

thedataobjectisfound.

RetentionPeriod N N String N

Thelengthoftimeadataobjectissettoberetained.

RetentionPolicyName N N String N

Thenameofthepolicythatlastsetretentionforadataobject.

SourceVolume Y N String N

TheoriginatingserverandsharenamefromwhichanobjectwascopiedtotheNetAppSnapLockServer.

AccessDate Y N Date Y

Atimestampthatindicatesthelastaccessedtimeofthedataobject.

Parenttopic:Metadatabyattributetype

RelatedconceptsMetadatabyattributetype

IBMUnstructuredData751, p. 525

Page 535: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ExchangeServermetadataattributesThistabledescribesmetadataforExchangeServerattributes.

Table1.MetadataforExchangeServerName Dense Multiple Type Normalized Description

AccessDate Y N Date Y

Atimestampthatindicatesthelastaccessedtimeofthefile.

Attachments Y N String NWhetherthedataobjecthasattachments.

BCC Y N String NRecipientsblind-copiedontheemaildataobject.

CC Y N String NRecipientsthatarecopiedontheemaildataobject.

CreationDate Y N Date YAtimestampthatindicatesthecreationtimeofthefile.

FileExtension Y N String N

Theextensionofthedataobject.ForExchange,thisextensionisalways.EML.

FileName Y N String N

Nameofthedataobject(file)locatedwithinthecontextofthespecifiedvolume.

FilePath Y N String N

Allattributesthatreferencethedataobject'slocation.

FileSize Y N Int N Thesizeofthefileinbytes.

From Y N String NThesenderoftheemaildataobject.

Importance Y N String N

Theimportancelevelthatisassignedbythesenderoftheemaildataobject:High,

Normal,Low.

IBMUnstructuredData751, p. 526

Page 536: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ModifiedDate Y N Date Y

Atimestampthatindicatesthemodificationtimeofthefile.

Sensitivity Y N String N

Thesensitivitylevelthatisassignedbythesenderoftheemaildataobject:Normal,Personal,Private,Confidential.

Parenttopic:Metadatabyattributetype

RelatedconceptsMetadatabyattributetype

IBMUnstructuredData751, p. 527

Page 537: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DiscoveryAcceleratormetadataattributesThistabledescribesmetadataforDiscoveryAcceleratorattributes.

Table1.MetadataforDiscoveryAcceleratorName Dense Multiple Type Description

LatestReviewStatus N N String

Allsystem-levelAcceleratorobjectshaveoneofthefollowingstatuses:Produced,Reviewed,Unreviewed,Pending,Questioned.

ReviewMarkNames N Y String

MarknamessetforeachReviewStatusthattheobjectwasputinto.Reviewmarksareuser-defined,andanobjectmighthavemultiplemarks.

ReviewComments N Y String

Comment(text)addedbyaReviewerinDiscoveryAcceleratorforthisobject.Anobjectmighthavemultiplereviewcomments.

Reviewers N Y String

LoginIDofaReviewerwhoeitheraddedaCommentoraStatus/Markontheobject.AnobjectmighthavemultipleReviewers.

MessageType N N String

Allsystem-levelAcceleratorobjectshaveoneofthefollowingmessages:Unknown,Exchange,InstantMessaging,Bloomberg,Fax,Lotus,FSA,SMTP

Parenttopic:Metadatabyattributetype

Relatedconcepts

IBMUnstructuredData751, p. 528

Page 538: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Metadatabyattributetype

IBMUnstructuredData751, p. 529

Page 539: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

FileNetmetadataattributesThistabledescribesmetadataforFileNetattributes.

Table1.MetadataforFileNetName Dense Multiple Type Description

FoldersFiledIn Y Y Object Thelistoffolderswherethisdocumentisfiled.

Id N Y GUID TheuniqueobjectID.ReferencesFileNetId.

Name N N String

ThisattributereturnsthevalueofthedesignatednamepropertyfortheobjectoritsIDifthereisnonameproperty.ReferencesFileNetName.

DateContentLastAccessed N N Date/time

Thedateandtimewhenthiscontentofadocumentwaslastaccessed.ReferencesFileNetDateContentLastAccessed.

DateCreated N N Date/timeThedateandtimethisobjectwascreated.ReferencesFileNetDateCreated.

DateLastModified N N Date/timeThedateandtimewhenthisobjectwaslastmodified.ReferencesFileNetDateLastModified.

ContentSize N N Float

Thesize(inbytes)ofthecapturedcontentthatisassociatedwiththisobject.ReferencesFileNetContentSize.

Owner N N StringThesecurityowneroftheobject.ReferencesFileNetOwner.

ContentRetentionDate N N Date/time

Thedateuntilwhichtheobjectmustberetained,asdeterminedbythecontentstoragesubsystem.ReferencesFileNetContentRetentionDate.

Creator N N StringThenameoftheuserwhocreatedthisobject.ReferencesFileNetCreator.

DateCheckedIn N N Date/timeThedateandtimethisobjectwascheckedin.ReferencesFileNetDateCheckedIn.

DocumentTitle N N String

DifferentfromDocument.name.ReferencesFileNetDocumentTitle.

IBMUnstructuredData751, p. 530

Page 540: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DocumentTitle.

IsCurrentVersion N N Boolean

Indicateswhetheritisthecurrentversionintheversionseries.Itisnotaseparateattribute,butratherusedtosettheCurrentstringinattributeVersionStatus(FileNet).ReferencesFileNetIsCurrentVersion.

IsFrozenVersion N N Boolean

Indicateswhetheruserpropertiesorcontentcanbemodified.Itisnotaseparateattribute,butratherusedtosettheFrozenstringinattributeVersionStatus(FileNet).ReferencesFileNetIsFrozenVersion.

IsInExceptionState N N Boolean

Indicateswhetherthelifecycleofadocumentisinexceptionstate.ReferencesFileNetIsInExceptionState.

IsReserved N N Boolean

Indicateswhetherauserreservedtherighttocheckinaversionafterthisversion.ReferencesFileNetIsReserved.

LastModifier N N StringThenameoftheuserwholastmodifiedthisobject.ReferencesFileNetLastModifier.

MajorVersionNumber N N Integer

Themajorversionnumberforthisdocumentversion.ReferencesFileNetMajorVersionNumber.

MimeType N N StringTheMIMEtypeofthedocument.ReferencesFileNetMimeType.

MinorVersionNumber N N Integer

Theminorversionnumberforthisdocumentversion.ReferencesFileNetMinorVersionNumber.

ReleasedVersion N N BooleanIndicateswhetheruserpropertiesorcontentcanbemodified.

VersionStatus N N Integer

Theversionstatusofthisdocumentversion.Thesestatusoptionsarelistedhere.

InProcessCurrentversionReleasedSuperseded

IBMUnstructuredData751, p. 531

Page 541: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

SupersededFrozen

Parenttopic:Metadatabyattributetype

RelatedconceptsMetadatabyattributetype

IBMUnstructuredData751, p. 532

Page 542: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

EmailmetadataattributesThistabledescribesmetadataforemailattributes.

Table1.Metadataforemail

Name Dense Multiple TypeAvailablefor

NonMicrosoftEmail

Description

Anyaddress N Y String YAnyrecipientorthesenderofanemailobject

Attachments

Whetherthedataobjecthasattachments.Trueifmessagehasattachments

BCC

Recipientsthatareblind-copiedontheemaildataobject

CC

Recipientsthatarecopiedontheemaildataobject

Clientsubmittime Y N Date Y

Conversationindex N N String N

Avaluethatindicatestherelativepositionofthismessagewithinaconversationthread

Conversationtopic N N String N

Thetopicofthefirstmessageinaconversationthread

Expiretime N N Date N

Thedateandtimeatwhichthemessagingsystemcaninvalidatethecontentofamessage(YYYY-MM-DD)

FromThesenderoftheemaildataobject

IBMUnstructuredData751, p. 533

Page 543: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Importance

Theimportancelevelthatisassignedbythesenderoftheemaildataobject:High,Normal,Low

InternetmessageID N N String Y

CorrespondstothemessageIDfieldasspecifiedin[RFC2822]

Is-part-of

TRUEifobjectispartofemailbody,emailattachment,miscellaneousemailitem'sbodyormiscellaneousemailitem'sattachment

Messagecreatetime N N Date Y

Datethemessagewascreated(YYYY-MM-DD)

Messagedeliverytime N N Date Y

Messagemodifytime N N String Y

Datethemessagewaslastmodified(YYYY-MM-DD)

Priority N N String Y

Theorderorspeedatwhichthemessagemustbesentbythemessagingsystemsoftware:Urgent,Normal,Low

ProofofDeliveryRequested N N Boolean N

TRUEifamessagesenderrequestsproofofdeliveryforaparticularrecipient

Proofof

TRUEifamessagesenderrequestsproofthatthemessagetransfer

IBMUnstructuredData751, p. 534

Page 544: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ProofofSubmissionRequested

N N Boolean N transfersystemwassubmittedamessagefordeliverytotheoriginallyintendedrecipient

ProviderSubmitTime N N Date Y

Thedateandtimeatransportproviderpassedthemessagetoitsunderlyingmessagingsystem(YYYY-MM-DD)

Receivedby N N String N Messagerecipient

Receiveddate

Datethemessagewasreceived(YYYY-MM-DD)

ReceivedRepresenting N N String N

Thedisplaynameforthemessaginguserthatisrepresentedbytherecipient

ReplyMessageID N N String Y

Theoriginalmessage'sPR_INTERNET_MESSAGE_IDpropertyvalue

ReplyMessagetime N N Date N

Timewhenthereplywassent(YYYY-MM-DD)

ReplyRequested N N Boolean Y

TRUEifamessagesenderrequestsareplyfromarecipient

Sensitivity

Thesensitivitylevelthatisassignedbythesenderoftheemaildataobject:Normal,Personal,Private,Confidential

SentdateDatethemessagewas

IBMUnstructuredData751, p. 535

Page 545: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Sentdate messagewassent(YYYY-MM-DD)

SentRepresenting N N String N

Containsthedisplaynameforthemessaginguserthatisrepresentedbythesender

SubjectThesubjectoftheemaildataobject

ToTherecipient/softheemaildataobject

TransportMessageHeaders

N N Date Y

Containstransport-specificmessageenvelopeinformation

Parenttopic:Metadatabyattributetype

RelatedconceptsMetadatabyattributetype

IBMUnstructuredData751, p. 536

Page 546: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DataobjectpropertyattributesThistabledescribesDataObjectPropertyAttributes.Dataobjectpropertyattributesarestoredinsidethedataobject.

Table1.DataobjectpropertyattributesName Dense Multiple Type

Comment N Y StringKeyword N Y StringLastsavedby N Y StringPrimaryauthor N Y StringSubject N Y StringTitle N Y StringAbstract N Y StringAccount N Y StringAddress N Y StringAttachments N Y StringAuthorization N Y StringBackupdate N Y StringBillto N Y StringBlindcopy N Y StringCarboncopy N Y StringCategory N Y StringCheckedby N Y StringClient N Y StringCompleteddate N Y StringCharacters N Y StringPages N Y StringWords N Y StringCreated N Y StringDepartment N Y StringDestination N Y StringDisposition N Y StringDivision N Y StringTotaleditingtime N Y StringEditor N Y StringForwardto N Y StringGroup N Y StringLanguage N Y StringPrinted N Y StringMailstop N Y String

Matter N Y StringOffice N Y StringOperator N Y StringOwner N Y StringProject N Y StringPublisher N Y StringPurpose N Y StringReceivedfrom N Y StringRecordedby N Y String

IBMUnstructuredData751, p. 537

Page 547: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Recordeddate N Y StringReference N Y StringRevisiondate N Y StringRevisionnotes N Y StringRevisionnumber N Y StringSecondaryauthor N Y StringSection N Y StringSecurity N Y StringSource N Y StringStatus N Y StringType N Y StringTypist N Y StringVersiondate N Y StringVersionnotes N Y StringVersionnumber N Y StringBasefilelocation N Y StringManager N Y StringCompany N Y StringLastsaved N Y StringPresentationformat N Y StringBytes N Y StringLines N Y StringParagraphs N Y StringSlides N Y StringHiddenslides N Y StringNotes N Y StringMultimediaclips N Y StringCharacters(withspaces) N Y String

Scalecrop N Y StringLinksdirty N Y StringTitleofparts N Y StringHeadingpairs N Y StringDocumentnumber N Y StringApplicationversion N Y StringUserdefined N Y String

Parenttopic:Metadatabyattributetype

RelatedconceptsMetadatabyattributetype

IBMUnstructuredData751, p. 538

Page 548: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

SharePointattributesThistabledescribesSharePointmetadataattributes.

Table1.MetadataforSharePointName Dense Multiple Type Normalized Description

CheckedOutTo Y N String N

Nameoftheuserwhocurrentlyhasthedataobjectcheckedout.Thisattributeisemptyifthefileisnotcheckedout.

CreatedDate Y N Date Y

Atimestampthatindicatesthecreationtimeofthefile.

Extension Y N String N

TheextensionofthedataobjectontheSharePointserver.

FileName Y N String N

Nameofthedataobjectlocatedwithinthecontextofthespecifiedvolume.

SystemPath Y N String N

Allattributesthatreferencethedataobject'slocation.

FileSize Y N Int NThesizeofthedataobjectinbytes.

ModifiedDate Y N Date Y

Atimestampthatindicatesthemodificationtimeofthedataobject.

Status Y N String N

Thestateofthedataobject:published,checkedout,orcheckedin.Thetitleofthedataobject.Bydefault,thisattribute

isthetitleoftheOffice

IBMUnstructuredData751, p. 539

Page 549: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Title Y N String N theOfficedocumentasshowninDocumentProperties.Configurablebytheuserduringcheck-in.

URL Y N String NTheURLthatpointstothedataobjectonSharePoint.

Version Y N String N

Theversionofthedataobject,fromaSharePointserverperspective

Parenttopic:Metadatabyattributetype

RelatedconceptsMetadatabyattributetype

IBMUnstructuredData751, p. 540

Page 550: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

CalendarmetadataattributesThistabledescribesmetadataattributesforcalendaritems.

Table1.MetadataforcalendarAttributeName Dense Multiple Type Normalized Description

Eventduration No No Integer No Timeinminutes

Eventenddate No No String Yes(ISO8601)Dateacalendarentryend(YYYY-MM-DD)

Eventlocation No No String Yes(lowercase)

Locationfieldinacalendarentry

Eventstartdate No No String Yes(ISO8601)

Datethatacalendarentrybegins(YYYY-MM-DD)

isMeeting No No Boolean No

Trueifthecalendarentryisameeting(Anyentrythathasattendees)

Parenttopic:Metadatabyattributetype

RelatedconceptsMetadatabyattributetype

IBMUnstructuredData751, p. 541

Page 551: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ContactmetadataattributesThistabledescribesmetadataattributesforcontacts.

Table1.MetadataforcontactAttributeName Dense Multiple Type Normalized Description

Businessaddress No No String Yes

(lowercase)

Businessaddressthatislistedforacontactentry

Businessphone No No String Yes

(lowercase)

Businessphonethatislistedforacontactentry

Company No No String Yes(lowercase)

Companythatislistedforacontactentry

Contactjobtitle No No String Yes

(lowercase)Jobtitlethatislistedforacontactentry

Contactkeywords No No String Yes

(lowercase)Keywordsthatarelistedforacontactentry

Department No No String Yes(lowercase)

Departmentthatislistedforacontactentry

Emaildisplayname No No String Yes

(lowercase)

Emaildisplaynamethatislistedforacontactentry

Fullname No No String Yes(lowercase)

Fullnamethatislistedforacontactentry

Homeaddress No No String Yes(lowercase)

Homeaddressthatislistedforacontactentry

Homephone No No String Yes(lowercase)

Homephonethatislistedforacontactentry

IMaddress No No String Yes(lowercase)

InstantMessengeraddressthatislistedforacontactentry

Mobilephone No No String Yes(lowercase)

Mobilephonenumberthatislistedforacontactentry

Officelocation No No String Yes(lowercase)

OfficelocationthatislistedforacontactentryPagernumber

IBMUnstructuredData751, p. 542

Page 552: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Pager No No String Yes(lowercase)

Pagernumberthatislistedforacontactentry

Webpage No No Yes(lowercase)

Webpagethatislistedforacontactentry

Parenttopic:Metadatabyattributetype

RelatedconceptsMetadatabyattributetype

IBMUnstructuredData751, p. 543

Page 553: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DigitalsignaturesmetadataattributesThistabledescribesattributesthatareusedinIBM®StoredIQdataanalysis.

Table1.MetadatafordigitalsignaturesAttributeName Dense Multiple Type Normalized Description

Encryptiontype No No Enum Yes

(lowercase)LotusNotes'or'General'

Hash Yes No String Yes(lowercase)

Hashvaluefortheobject

NSRLdigitalsignature Yes No Boolean No

Trueiftheobject'shashvaluematchesanitemontheNSRLhashlist

Parenttopic:Metadatabyattributetype

RelatedconceptsMetadatabyattributetype

IBMUnstructuredData751, p. 544

Page 554: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ProcessingmetadataattributesThistabledescribesattributesthatareusedindataprocessing.

Table1.MetadataforprocessingdataAttributeName Dense Multiple Type Normalized Description

Binaryprocessingstate

Yes No Integer Yes

Stateofbinaryprocessing:NotPerformed,Successful,Partial,Failed

Binaryerrorcode No Yes String Yes

(lowercase)

Whenbinaryprocessingisperformed,thefollowingcodesapply:Indexingofbinarytextfailed,Binarytextpartiallyindexed,Binarycontenttaggingfailed,Maxentitiesreachedinbinarytext,Binarytextextractionfailed,Binaryfullprocessingcompleted

Contentprocessingstate

Yes No Integer Yes

Stateofcontentprocessing:NotPerformed,Successful,Partial,Failed

Contenterrorcode

No Yes String Yes(lowercase)

Whenthecontentprocessingstateis"Partial"or"Failed,"thefollowingcodesapply:Configuredskippeddataobject,Unsupportedfileformat,Configuredmax.objectsize,Indexingfailed,Partially

indexed,Unknownfile

IBMUnstructuredData751, p. 545

Page 555: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

code (lowercase) Unknownfileformat,Contenttaggingfailed,Maxentitiesreached,Encryptedorpasswordprotected,Textextractionfailed,Notextinthisfileformat,Couldnotreadsourceobject,Maxentityvaluelengthreached

Object Yes No Integer Yes

Systemprocessingstate

Yes No Integer Yes

Stateofsystemprocessing:Successful,Partial

Systemerrorcode No Yes Yes

(lowercase)

Whensystemprocessingstateis"Partial,"thefollowingcodeapplies:User/Grouplookupfailed

Parenttopic:Metadatabyattributetype

RelatedconceptsMetadatabyattributetype

IBMUnstructuredData751, p. 546

Page 556: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

TaskmetadataattributesTable1.Metadatafortaskitems

AttributeName Dense Multiple Type Normalized Description

Taskcomplete No No Boolean NoTrueifthetaskismarkedascomplete

Taskduedate No No String Yes(ISO8601)Datethetaskismarkedasbeingdue(YYYY-MM-DD)

Taskowner No No String Yes Creatorofthetask

Taskpercentcomplete No No Integer Yes

Percentcompleteofatask

Taskstartdate No No String Yes(ISO8601)Datethetaskismarkedasbeingstarted(YYYY-MM-DD)

Taskstatus No No String Yes Statusofatask

Parenttopic:Metadatabyattributetype

RelatedconceptsMetadatabyattributetype

IBMUnstructuredData751, p. 547

Page 557: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

AttributevaluetypesThistabledescribesthevalueandinstance-basedexpressionsthatcanbeusedwithaquerycondition,dependingonthetypeofattribute.

Table1.AttributevaluetypesValueType Dense Sparse

SingleInstance Multi-instance SingleInstance Multi-instance

String

Appears AppearsAppearsuniquely AppearsuniquelyDoesnotappear Doesnotappear

Is Is Is IsIsnot Isnot Isnot IsnotContains Contains Contains ContainsDoesnotcontain Doesnotcontain Doesnotcontain DoesnotcontainBeginswith Beginswith Beginswith BeginswithEndswith Endswith Endswith EndswithMatchesregularexpression

Matchesregularexpression

Matchesregularexpression

Matchesregularexpression

atleastntimes(n>0) atleastntimes

atmostntimes(n>0) atmostntimes

exactlyntimes(n=0) exactlyntimes

Date

Appears AppearsAppearsuniquely AppearsuniquelyDoesnotappear Doesnotappear

Is Is Is IsBetweenxandydaysago

Betweenxandydaysago

Betweenxandydaysago

Betweenxandydaysago

Atleastxdaysago

Atleastxdaysago

Atleastxdaysago

Atleastxdaysago

Atmostxdaysago

Atmostxdaysago

Atmostxdaysago

Atmostxdaysago

atleastntimes(n>0) atleastntimes

atmostntimes(n>0) atmostntimes

exactlyntimes(n=0) exactlyntimes

Appears AppearsInt Appears Appears

Appearsuniquely AppearsuniquelyDoesnotappear Doesnotappear

Equals Equals Equals EqualsAtleast Atleast Atleast AtleastAtmost Atmost Atmost Atmost

Between Between Between Betweenatleastntimes(n>0) atleastntimes

IBMUnstructuredData751, p. 548

Page 558: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

(n>0)atmostntimes(n>0) atmostntimes

exactlyntimes(n=0) exactlyntimes

Notperformed NotperformedSuccessful SuccessfulPartial PartialFailed Failed

Parenttopic:Metadatabyattributetype

RelatedconceptsMetadatabyattributetype

IBMUnstructuredData751, p. 549

Page 559: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

IBMLotusNotesmetadataattributesThistabledescribesmetadataforIBMLotusNotesattributes.

Table1.MetadataforIBMLotusNotesAttributeName Dense Multiple Type Normalized Description

Attachments

Whetherthedataobjecthasattachments.Trueifmessagehasattachments

Bcc,BlindCopyTo,EnterBlindCopyTo

Recipientsthatareblindcopiedontheemaildataobject

CC,CoptyTo,EnterCopyTo

Recipientsthatarecopiedontheemaildataobject

Thread_Topic N N String N

Thetopicofthefirstmessageinaconversationthread

FromThesenderoftheemaildataobject

Importance

Theimportancelevelthatisassignedbythesenderoftheemaildataobject:High,Normal,Low

Message-ID N N String Y

CorrespondstothemessageIDfieldasspecifiedin[RFC2822]

Is-part-of

TRUEifobjectispartofemailbody,emailattachment,miscellaneousemailitem'sbodyormiscellaneousemailitem's

attachmentDatethe

IBMUnstructuredData751, p. 550

Page 560: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Create,ComposedDate N N Date Y

Datethemessagewascreated(YYYY-MM-DD)

DeliveredDate N N Date Y

Modify N N String Y

Datethemessagewaslastmodified(YYYY-MM-DD)

DeliveryPriority N N String Y

Theorderorspeedatwhichthemessagemustbesentbythemessagingsystemsoftware:Urgent,Normal,Low

ReturnReceipt N N Boolean N

TRUEifamessagesenderrequestsproofofdeliveryforaparticularrecipient

Sensitivity

Thesensitivitylevelthatisassignedbythesenderoftheemaildataobject:Normal,Personal,Private,Confidential

Sent,PostedDatethemessagewassent(YYYY-MM-DD)

SentRepresenting-Name N N String N

Containsthedisplaynameforthemessaginguserthatisrepresentedbythesender

SubjectThesubjectoftheemaildataobject

To,SendToTherecipient/softheemaildataobject

Attachments

Whetherthedataobjecthasattachments.Trueifmessagehas

IBMUnstructuredData751, p. 551

Page 561: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

messagehasattachments

Parenttopic:Metadatabyattributetype

RelatedconceptsMetadatabyattributetype

IBMUnstructuredData751, p. 552

Page 562: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

EnterprisevaultmetadataattributesThistabledescribesmetadataforenterprisevaultattributes.

Table1.MetadataforenterprisevaultName Dense Multiple Type Description

Archivedate(EnterpriseVault)

N N DateDatethattheobjectwasarchived(YYYY-MM-DD).

Author(EnterpriseVault)

N N StringThecreatoroftheobject,asshowninthearchiveproperties

Contentfingerprint(EnterpriseVault)

N N StringContentfingerprintoftheobject

CustomID(EnterpriseVault)

N N StringApplication-specificIDfortheobject

Customproperties(EnterpriseVault)

N Y StringApplication-specificinformationfortheobject

Dedupefingerprint(EnterpriseVault)

N N StringDeduplicationfingerprintoftheobject

DominoUNID(EnterpriseVault)

N N String DominoUniversalNoteID

FSAoriginalname(EnterpriseVault)

N N StringFilesystemarchiveoriginalname

Keywords(EnterpriseVault)

N Y StringKeywordsthatareassociatedwiththedataobject

Messagetype(EnterpriseVault)

N N StringDatatypeoftheobject(DOC,XLS,MSG)

Missingcontentreason(EnterpriseVault)

N N NumericStringReasonthatobjectcontentisnotavailableinthearchive

Originallocation(EnterpriseVault)

N N StringOriginallocationofthearchivedobject

Retentioncategory(EnterpriseVault)

N N StringNameofretentioncategorythatisappliedtotheobject

Retention

expires(Enterprise

N N DateString

Datethatthe

retentionontheobjectexpires

IBMUnstructuredData751, p. 553

Page 563: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

(EnterpriseVault)

objectexpires(YYYY-MM-DD)

Parenttopic:Metadatabyattributetype

RelatedconceptsMetadatabyattributetype

IBMUnstructuredData751, p. 554

Page 564: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

JivemetadataattributesThistabledescribesattributesthatareusedinJiveitems.

Table1.MetadataforJiveAttributeName Dense Multiple Type Normalized Description

AuthorID(Jive) No No String No

TheuniqueIDoftheauthorwithinJive.

AuthorName(Jive) No No String No

Theauthor'sfullnamewithinJive.

AuthorUsername(Jive)

No No String NoTheauthor'susernamewithinJive.

ContentID(Jive) No No String No

TheuniqueIDofcontentwithinJive.

ContentURL(Jive) No No String No

Thecontent'sURLwithinJive.

DiscussionQuestion(Jive) No No Boolean No

IndicateswhethertheJivediscussionwasmarkedasaquestion.

LikeCount(Jive) No No Date No

Indicatesthatthenumberoftimesthatcontentwasmarkedas"liked"onJive.

PlaceID(Jive) No No String NoTheuniqueIDoftheparentplaceonJive.

PlaceName(Jive) No No String No

ThenameoftheparentplaceonJive.

PlaceURL(Jive) No No String No

TheURLoftheparentplaceonJive.

PublishedDate(Jive) No No Date No

Thepost'spublisheddateonJive.

ReplyCount(Jive) No No Date No

IndicatesthatthenumberofrepliespostedtocontentonJive.

Status(Jive) No No String NoIndicatesadiscussion'sstatusonJive.

Subject(Jive) No No String NoIndicatescontent's

subjectonJive.

IBMUnstructuredData751, p. 555

Page 565: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Version(Jive) No No String NoIndicatesadocument'sversiononJive.

ViewCount(Jive) No No Date No

IndicatesthatthenumberoftimescontentwasviewedonJive.

Parenttopic:Metadatabyattributetype

RelatedconceptsMetadatabyattributetype

IBMUnstructuredData751, p. 556

Page 566: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ChattermetadataattributesThistabledescribesattributesthatareusedinChatteritems

Table1.MetadataforChatterAttributeName Dense Multiple Type Normalized Description

ObjectID(Chatter) No No String No

TheuniqueIDoftheobjectwithinChatter.

Objecttype(Chatter) No No String No

ThetypeofobjectwithinChatter.

ParentgroupID(Chatter) No No String No

TheuniqueIDoftheparentgrouporprofilewithinChatter.

Parentgroupname(Chatter)

No No String No

ThenameoftheparentgrouporprofilewithinChatter.

ParentpostID(Chatter) No No String No

TheuniqueIDoftheparentpostwithinChatter.

Parentposttype(Chatter) No No Boolean No

TheobjecttypeoftheparentpostwithinChatter.

CreatedbyuserID(Chatter)

No No Date NoTheuniqueIDofthecreatorwithinChatter.

Createdbyusername(Chatter)

No No String NoTheusernameofthecreatorwithinChatter.

Createddate(Chatter) No No Datetime No

TheposteddatewithinChatter.

Commentcount(Chatter)

No No Integer NoThenumberofcommentsforapostwithinChatter.

Likecount(Chatter) No No Integer No

Thenumberof"likes"forapostorcommentwithinChatter.

Title(Chatter) No No String NoThetitleforlinksandattachmentswithinChatter.

LinkURL(Chatter) No No String No

ThecontentoflinkspostedwithinChatter.

IBMUnstructuredData751, p. 557

Page 567: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Parenttopic:Metadatabyattributetype

RelatedconceptsMetadatabyattributetype

IBMUnstructuredData751, p. 558

Page 568: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ManagingIBMStoredIQeDiscoveryIBM®StoredIQeDiscoverycapturesandmanagestheelectronicdatainyoursystem.IBMStoredIQeDiscoveryuses"matter"tocreateandorganizeinformationsothatyoucanalwayseasilyaccessthedatathatyouneedandreviewthestatusorprocessofyourwork.

ThefollowingtopicsdescribeindetailhowtouseIBMStoredIQeDiscoverytoachieveyourbusinessgoals.

OverviewofIBMStoredIQeDiscoveryIBMStoredIQeDiscoveryisdesignedforthelegaluserstomanagetheirelectronicdata.Withthisapplication,youcancaptureandcontrolthedatatocommunicatewithotherusersabouttheworkstatusandcasereviewprocess.ActionsonamatterProvidesinstructionsabouthowtomanagemattersontheMatterDashboard.MatterconfigurationMattersarethebasisofanye-discoverywork.Throughmatterconfiguration,youcantunethemtomeetyourlegalneeds.ActionsonaboxWhenanIdentificationBoxiscreated,multipleactionsareavailabletohelpyoucategorizeandmovedataobjectsaspartofthee-discoveryprocess.

Parenttopic:ManagingtheIBMStoredIQproducts

IBMUnstructuredData751, p. 559

Page 569: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

OverviewofIBMStoredIQeDiscoveryIBM®StoredIQeDiscoveryisdesignedforthelegaluserstomanagetheirelectronicdata.Withthisapplication,youcancaptureandcontrolthedatatocommunicatewithotherusersabouttheworkstatusandcasereviewprocess.

IBMStoredIQeDiscoveryidentifiesandcatalogsdataortypesofdatathatcaneventuallyberesponsivetolegalmatters.ThedatathatiscollectedandretainedbyIBMStoredIQeDiscoveryisthenproducedinawaythatmatchesacceptedorrequiredlegalpractices.

IBMStoredIQeDiscoverycanbeusedtoaccomplishanyofthesetasks:

Createamatterforalawsuit.Createboxestocontainemailsandreportsaboutcases.Visualizethestatusofthedifferentactivematters.Communicatewithemailsdirectlyfromtheapplicationtodiscussanyquestionsaboutamatter.

BeforeyouuseIBMStoredIQeDiscovery,ensurethatyoumeettheseprerequisites:

TheIBMStoredIQPlatformmustbedeployed,configured,andreadyforuse.IBMStoredIQeDiscoveryisdependentuponotherIBMStoredIQapplicationssuchasIBMStoredIQAdministratorandIBMStoredIQDataWorkbench.

SwitchingbetweenapplicationsWiththeIBMStoredIQproduct,youcanswitchbetweendifferentapplications.

IBMUnstructuredData751, p. 560

Page 570: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

SwitchingbetweenapplicationsWiththeIBMStoredIQproduct,youcanswitchbetweendifferentapplications.

AboutthistaskTheseapplicationsinclude:

IBMStoredIQDataWorkbenchIBMStoredIQeDiscoveryIBMStoredIQDataScriptIBMStoredIQPolicyManagerIBMStoredIQAdministrator

Toswitchtotheapplicationthatyouwanttoworkon,followthesesteps.

Procedure1. Withintheglobalnavigationbar,clickthewhitearrownexttothenameofthe

application.Amenuappears,listingavailableIBMStoredIQPlatformapplications.2. Inthemenu,clickthenameoftheapplicationtowhichyouwanttoswitch.

Note:Therearefourrolesforusers:administrator,datauser,discoveryuser,andpolicyuser.DifferentIBMStoredIQPlatformapplicationsareavailabletotheuser,dependingonwhatroleswereselected.AdministratorshaveaccesstoIBMStoredIQAdministratorinadditiontoIBMStoredIQDataWorkbench,IBMStoredIQeDiscovery,andIBMStoredIQDataScript.DiscoveryusershaveaccesstoIBMStoredIQeDiscovery.DatausershaveaccesstoIBMStoredIQDataWorkbench.PolicyusershaveaccesstoIBMStoredIQPolicyManager.

Parenttopic:OverviewofIBMStoredIQeDiscovery

IBMUnstructuredData751, p. 561

Page 571: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ActionsonamatterProvidesinstructionsabouthowtomanagemattersontheMatterDashboard.

MatterDashboardviewTheMatterDashboardprovidesahigh-leveloverviewofmatterswithinIBM®StoredIQeDiscovery.Ithelpsyoutofindandidentifymattersofinterest.

IBMUnstructuredData751, p. 562

Page 572: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

MatterDashboardviewTheMatterDashboardprovidesahigh-leveloverviewofmatterswithinIBM®StoredIQeDiscovery.Ithelpsyoutofindandidentifymattersofinterest.

AmatterisacentralcontainerobjectwithinIBMStoredIQeDiscovery.Youcanorganizeallinformationthatpertainstoapotentialoractivelegalmatter.Matterscanbeseenonthematterdashboard.Itshowsamatter'sstatuswhileitprovidescriticalpiecesofinformationforeachmatter:itsmatterandboxnavigationtrail,itsname,abriefdescription,itscreationdateandtime,andavisualcueaboutitsstatus.Italsoprovidesinsightintothecontentsofthematter,includingwhatboxesandreportsitcontainsandrelevantcontactsforthematter.Mattersarelistedaccordingtothetimesequenceoftheircreation.FromtheMatterDashboard,youcandothefollowingtasks:

Viewamatterbyclickingthematterthatyouwanttosee.Searchforamatterbyfilteringtheexistingmatters.AddamatterbyclickingCreateMatter.

ViewofamatterThroughaccessingthematter,youcanviewthecontentsofanexistingmattersuchasitsboxesandreports.EmailingthecontactpersonofamatterYoucanemailthecontactpersonofamatterbyclickingthenameofthatpersonontheMatterDashboard.FilteringforamatterYoucanfilterforaspecificmatterwithinexistingmattersfromtheMatterDashboard.AddingamatterAmatterisacontainerthatencapsulatesalldatathatyouaregatheringforaspecificlegalcase.Itcanalsocontainsomeconstrainingparameterssuchasmatterdatesandidentifyinginformationlikethematter'snameanddescription.MattersareanessentialcomponentofusingIBMStoredIQeDiscoveryandcanbeaddedfromtheMatterDashboard.DeletingamatterMatterscanbedeletedfromtheMatterDashboard.

Parenttopic:Actionsonamatter

RelatedconceptsActionsonamatter

IBMUnstructuredData751, p. 563

Page 573: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ViewofamatterThroughaccessingthematter,youcanviewthecontentsofanexistingmattersuchasitsboxesandreports.

OntheMatterDashboard,double-clickthematterthatyouwanttoview.ThematteropensontheMatterDetailspage.

Parenttopic:MatterDashboardview

RelatedconceptsMatterDashboardview

IBMUnstructuredData751, p. 564

Page 574: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

EmailingthecontactpersonofamatterYoucanemailthecontactpersonofamatterbyclickingthenameofthatpersonontheMatterDashboard.

Procedure1. FromtheMatterDashboard,findthematterthatcontainsthecontactpersonyouwant

toemail.2. IntheContactsareaofthatmatter,clickthenameoftheindividualyouwanttoemail.An

emailtothatindividualautomaticallyopensinyouremailclientwiththematter'snameasthesubjectoftheemail.Note:TheDataExpertforaboxcanalsobeemailedbyclickingContactDataExpertonthematter'sBoxesandReportspage.

Parenttopic:MatterDashboardview

RelatedconceptsMatterDashboardview

IBMUnstructuredData751, p. 565

Page 575: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

FilteringforamatterYoucanfilterforaspecificmatterwithinexistingmattersfromtheMatterDashboard.

Procedure1. FromtheMatterDashboard,intheEntertermshere....textbox,enterthenameofthematterforwhichyouwanttofilter,andthenpressSearch.Youcanentereitherthefullmatternameoraportionofit.Onlymatternamesthatmatchthefilterentryaredisplayedinthelist.Mattersthatmatchtheenteredsearchtermarereturned.

2. Viewthematterbydouble-clickingitwithintheMatterDashboard.3. Toremovethesearchterm,clicktheXtotheleftoftheEntertermshere....textbox.

Parenttopic:MatterDashboardview

RelatedconceptsMatterDashboardview

IBMUnstructuredData751, p. 566

Page 576: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

AddingamatterAmatterisacontainerthatencapsulatesalldatathatyouaregatheringforaspecificlegalcase.Itcanalsocontainsomeconstrainingparameterssuchasmatterdatesandidentifyinginformationlikethematter'snameanddescription.MattersareanessentialcomponentofusingIBM®StoredIQeDiscoveryandcanbeaddedfromtheMatterDashboard.

Procedure1. WithintheMatterDashboard,clickCreateMatter.TheCreateMatterdialogbox

appears.TheCreateMatterdialogboxhasfourfields:Name,Description,DataExpertContact,andLegalOpsContact.

2. IntheNametextbox,enterauniquenameforthismatter.ThisnameappearsontheMatterDashboardpage,providingyouaneasywaytoidentifythematter.

3. IntheDescriptiontextbox,enterauniquedescriptionofthismatter.4. IntheDataExpertContacttextbox,selecttheuserthatservesastheDataExpertfor

thismatter.TheusersinthislistarepopulatedwiththeIBMStoredIQAdministratorusermanagementfeature.

5. IntheLegalOpsContacttextbox,selecttheuserthatservesastheLegalOperationscontactforthismatter.TheusersinthislistarepopulatedwiththeIBMStoredIQAdministratorusermanagementfeature.

6. ClickSave.ThenewlycreatedmatterappearswithintheMatterDashboard.Whenyouhaveamatter,thenyoucancreateboxesandbegintomanageyoure-discoveryprocess.

Parenttopic:MatterDashboardview

RelatedconceptsMatterDashboardview

IBMUnstructuredData751, p. 567

Page 577: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DeletingamatterMatterscanbedeletedfromtheMatterDashboard.

Procedure1. WithintheMatterDashboard,placeyourmouseoverthematteryouwanttodelete.2. ClickDelete,whichappearswithintheContacttile.TheDeleteMatterconfirmationbox

appears.Note:Youcannotdeleteamatterthathasaboxinapendingstate.

3. WithintheDeleteMatterconfirmationbox,clickDelete,andthematterisremovedfromtheMatterDashboard

Parenttopic:MatterDashboardview

Parenttopic:Matterconfiguration

RelatedconceptsMatterDashboardviewMatterconfiguration

IBMUnstructuredData751, p. 568

Page 578: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

MatterconfigurationMattersarethebasisofanye-discoverywork.Throughmatterconfiguration,youcantunethemtomeetyourlegalneeds.

EditingamatterUsethefollowingproceduretoeditanexistingmatter.DeletingamatterMatterscanbedeletedfromtheMatterDashboard.CreatingaboxAboxisacontainerforrequesteddatawithinamatter.Itservesastheobjectofreferenceasyoumovefrommanaginginformationthroughtodataidentification,collection,andexport.EditingthesummaryofaboxWhenyouareeditingabox,youcanmodifythebaseinformationormetadatathatisenteredduringboxcreation.

IBMUnstructuredData751, p. 569

Page 579: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

EditingamatterUsethefollowingproceduretoeditanexistingmatter.

Procedure1. WithintheMatterDashboard,double-clickthematterthatyouwanttoedit.Thematter

opens,showingboththeMatterDashboardfortheselectedmatterandthematter'sboxesandreports.

2. Intheupperright-handcorner,clickEditMatter.TheEditMatterdialogboxappears.3. Editthematterasneeded,changingthenameordescriptionofthematter.4. ClickSave.

Parenttopic:Matterconfiguration

RelatedconceptsMatterconfiguration

IBMUnstructuredData751, p. 570

Page 580: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Creatingabox

Aboxisacontainerforrequesteddatawithinamatter.Itservesastheobjectofreferenceasyoumovefrommanaginginformationthroughtodataidentification,collection,andexport.

BoxesarecreatedwithinmatterfromtheBoxesandReportspage,whichhasfourareas:Boxes,Summary,Reports,andAvailableActions.

BoxThistabledescribesthefieldsthatappearontheleftsideoftheMatterOverviewscreen,labeledBoxes.

Table1.BoxtablefieldsanddescriptionsFieldName Description

Name Thenameoftheboxwithinthematter.Type Alistofthetypeofthebox.OptionsincludeIdentification,Export,andCollection.Created Alistofthedateandtimeatwhichtheboxwascreated.

Status Thesystemstatusofthebox.OptionsincludeActiveorPending.IftheboxisinaPendingstate,certainlinkssuchasFileListandDataMapcanbedisabled.

TotalBoxObjects

Thisfieldliststhetotalnumberofdataobjectsintheselectedbox.Ifaboxisselectedinthetable,thenthecountsinthisfieldupdatetoreflecttheselectedbox.

EstimatedTotalBoxSize

Thisfieldliststheestimatedtotalsizeofdataobjectsintheselectedbox.Ifaboxisselectedinthetable,thenthecountsinthisfieldupdatetoreflecttheselectedbox.

Selectingabox

1. IntheAllBoxeslist,selectthetypeofboxyouwanttoview.OptionsincludeAllBoxes,IdentificationBoxes,CollectionBoxes,andExportBoxes.

IdentificationBoxes:Identifyingdataisakeystepinthee-discoveryprocessthatisbasedonseveralmethods,includingcustodiansandmatterterms.AnIdentificationBoxistheinitialtypeofboxthatiscreatedwhenyouareconfiguringamatter,anditiskeytodefiningthedatawithinamatter.CollectionBoxes:ACollectionBoxcollectsdataforpreservationwhenitisapproved.ExportBoxes:AnExportBoxretainsspecificdatawhenitisapprovedforexport.

2. Dependingontheselectionthatyoumade,boxesofthattypeappearintheBoxestable.Note:Bydefault,theonlytypeofboxyoucancreateisanIdentificationBox.WhenyoucreateanIdentificationBox,youcancreateaCollectionBoxorExportBoxthatisbasedontheoriginalIdentificationBox.

SummaryThistabledescribestheSummaryareaontherightsideoftheMatterOverviewscreen.

Table2.SummaryoptionsanddescriptionsFieldName Description

Name Thenameoftheselectedbox.Description Thedescriptionoftheselectedbox.

DetailsProvideslinkstodetaileddataforthebox,includingFileListandDataMap.Whenaboxisinapendingstate,theselinksaredisabled.

Started Thecreateddateandtimeofthebox.

IBMUnstructuredData751, p. 571

Page 581: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Started Thecreateddateandtimeofthebox.Status Thesystemstatusoftheselectedbox:ActiveorPending.

ReportsThistabledescribestheReportsareaontherightsideoftheMatterOverviewscreen.

Table3.ReportsoptionsanddescriptionsFieldName Description

Name Thenameofthereport.Created Thecreationdateandtimeofthereport.OverallStatus Thecreationstatusofthereport.OptionsincludeCompleteorPending.

AvailableActionsThisareaprovideslinkstowhatactionscanbetakenonaselectedbox.Fromhere,youcanclickalinktoactonabox.Theselinkoptionsareavailable:

CreateIdentificationBoxRefinethisboxRestartthisboxCreateaCollectionBoxthatisbasedonthisboxCreateanExportBoxthatisbasedonthisboxClonethisboxRunareportonthisboxDeletingthisbox

Creatinganidentificationbox

1. Selectthematterinwhichyouwanttocreateabox.2. ClickCreateIdentificationBox.TheCreateBoxdialogboxappears.Therearefive

subtabsintheCreateIdentificationBoxdialogbox:BaseInformation,WhereandWhen,Who,Terms,andNotes.

3. WithintheBaseInformationsubtab,completethesefields.a. IntheNametextbox,enterthenamefortheboxanditsoutputs.b. Optionally,intheDescriptiontextbox,enterabriefdescriptionofthebox.c. ClickNexttoaccesstheWhereandWhensubtab.

4. WithintheWhereandWhensubtab,completethesefields.a. IntheFileLocalecheckboxes,selectatleastonelocaleforthisbox.Options

includeAllUserData,FileShares,Emails,Desktops,andCollaborationFiles.Note:IfyouselecttheAllUserDatacheckbox,allfile-localeoptionsareautomaticallyselected.

b. IntheTimeIntervalarea,enterthestartandenddatesforthisbox.c. ClickNexttoaccesstheWhosubtab.

5. WithintheWhosubtab,completethesefields.a. Selectidentitiestoactascustodiansforthebox.UseAddandRemovetomove

custodiansfromtheAllIdentitieslisttotheBoxCustodianslist.Note:IdentitiesarecreatedbyanadministratorintheconceptportionofIBM®StoredIQAdministrator.Note:Searchforaspecificidentitybyenteringalloraportionoftheuser'snameintheEnterterms...textboxandclickingSearch.

b. SelectAnyIdentitiesorAllIdentities.ThisfieldisaBooleanAND/ORvalue.Note:Bydefault,AnyIdentitiesisselected.BychangingtheAnyIdentities/AllIdentitiessetting,youmightobtainunexpectedresults.

c. ClickNexttoaccesstheTermssubtab.6. WithintheTermssubtab,completethesefields.

Note:Enteredtermsareusedaspartofafull-textsearchwithinaninfoset.Thedataobjectswithintheinfosetmustbepartofthefull-textindextoreturnresults.

a. Optionally,enterlitigationtermsforthisbox.IntheEntertermandclickAdd

IBMUnstructuredData751, p. 572

Page 582: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

textbox,enterthewantedlitigationterm,andthenclickAdd.Note:UseDeleteandDeleteAlltoremoveaddedlitigationterms.

b. SelectAnyTermorAllTerms.ThisvalueisaBooleanAND/ORvalue.Note:Bydefault,AnyTermisselected.BychangingtheAnyTerm/AllTermssetting,youmightobtainunexpectedresults.

c. ClickNexttoaccesstheNotessubtab.7. WithintheNotessubtab,optionallyenternotesorextrainstructionsforthebox's

dataexpert.IntheNotestoDataExperttextbox,entertheinformation.Note:Thistextboxhasalimitof2,000characters.

8. ClickFinish.TheBoxesandReportspageofthematterpopulateswiththeparameterssetduringboxcreationwiththeboxinaPendingstate.

9. WhenanIdentificationBoxiscreated,itisplacedinaPendingstate.AnemailissenttotheDataExpert,indicatingthattheDataExpertmustgeneratearesponsethatmatchestheparametersthatareindicatedintheboxrequest.Tocompletetheinfosetrequest,theDataExpertmustclicktheURLinthesystem-generatedemail.

10. Whentheinfosetisaddressed,theboxmovesfromaPendingtoAvailablestate,atwhichpointmoreactionsbecomeavailabletothatbox.TheactionsavailableintheAvailableActionsareathatischangedfromasingleoption,CreateIdentificationBox,tomultipleoptions.

Parenttopic:Matterconfiguration

RelatedconceptsMatterconfiguration

IBMUnstructuredData751, p. 573

Page 583: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

EditingthesummaryofaboxWhenyouareeditingabox,youcanmodifythebaseinformationormetadatathatisenteredduringboxcreation.

Procedure1. Withinthematter,selecttheboxthatyouwanttoeditintheBoxestable.2. IntheSummaryarea,clickEdit.3. Modifythesummaryoptionsoftheboxasneeded.

DatamapsThedatamapprovidesavisuallayoutofyourdataandin-depthinformationaboutdatasourcetypes,datacategories,sizeoramounts,thenumberofdataobjects,anddetails.ViewingthefilelistordatamapThefilelistanddatamaphelpsyoutoexploreyourdata,itsdetails,andrelationships.

Parenttopic:Matterconfiguration

RelatedconceptsMatterconfiguration

IBMUnstructuredData751, p. 574

Page 584: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DatamapsThedatamapprovidesavisuallayoutofyourdataandin-depthinformationaboutdatasourcetypes,datacategories,sizeoramounts,thenumberofdataobjects,anddetails.

Thedatamapcontainstheseareas:DataMapOption Description

GroupBy

TheGroupByareacontainstheseoptions:

DataSourceType:Thisviewdisplaysthedifferentdatasourcetypesthatmakeuptheselectedinfoset.Byselectingorclearingthedatasourcetypes,thedatamapautomaticallyreconfigures,providingyouwithavisualoverviewofyourdata.None:Thisoptionremovesdatasourcetypesfromthedatamap.

ViewBy

TheViewByareacontainstheseoptions:

CategoryView:Viewdatabycategory,includingcontainerfilesandarchives,images,spreadsheets,andemail.SizeView:Viewdatabysize,fromlessthanoneMBtoover100GB.TheSizeViewisonlyactiveforinfosetsthathaveatop-levelcomposition.CreatedView:Viewdatabycreateddatefromwithinthepast30daystomorethanfiveyearsago.LastModifiedView:Viewdatabyitslastmodifieddate,fromwithinthepast30daystomorethanfiveyearsago.LastAccessedView:Viewdatabyitslastaccesseddate,fromwithinthepast30daystomorethanfiveyearsago.

Byselectingorclearingtheviewingoptions,thedatamapautomaticallyreconfigures,providingyouwithavisualoverviewofyourdata.

DataMap

Withinthedatamap,youhavetheseviewingoptions.

ObjectCount:Thedatamapdisplaysthenumberofobjectsandtheirpercentageofthatdatasourcewhenyouplacethepointeroveracategory.ObjectSize:Thedatamapdisplaysthesizeandpercentageoftheobjectsforthatdatasourcewhenyouplacethepointeroveracategory.ObjectSizeisonlyactiveforinfosetsthathaveatop-levelcomposition.

Youalsohavetheseviewingoptions:

Squarify:Thisviewdepictsdataasunorderedsquaresratherthanrectangles.Slice&Dice:Thisviewdepictsdataasorderedrectangles.Strip:Thisviewstripsdata,depictingitintheeasiestviewingaspectpossible.

Thisareadisplaysdetailsaboutatilethatisselectedinthedatamap.Byclickinganindividualmaptile,detailsaboutthatspecifictilearedisplayed.Youcanalsoseethetotalnumberofdataobjectsreferredtobythemaptile.WithintheDataMapDetails,youhavetheseviewingoptions.

Volumes:IftheVolumesoptionisselected,thevolume'snameandviewselecteddisplaysintheDataMapDetailsfortheselectedtile.Thebargraphpopulatesautomaticallybasedonthecountorsizeoftheselectedtile.Owners:IftheOwnersoptionisselected,theownersofcontent

IBMUnstructuredData751, p. 575

Page 585: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DataMapDetails

Owners:IftheOwnersoptionisselected,theownersofcontentdisplayswithinthattilearedisplayedintheDataMapDetails.Thebargraphpopulatesautomaticallybasedonthecountorsizeoftheselectedtile.

Note:Selectedtileshaveagreenborder.Tilesoverwhichthepointerwasplacedhaveablackborder.

TheDataMapDetailsalsoshowsyoutheTotalSizeoftheselectedtile.Thebargraphautomaticallypopulates,providingavisualrepresentationofhowthesizeoftheselectedtilerelatestothatofthesizeoftheinfosetasawhole.

ByclickingViewFullList,theDataMapDetailsdialogappears.Fromhere,youcandownloadinformationabouttheselectedtiletoaCSVfile.

Viewingxofxtotalobject

Underthedatamap,thisfielddisplaysthefollowingoptions.

IfObjectCountisselected,thisfigureindicatesthenumberofdataobjectsthatarebeingviewedcomparedtothetotalnumberofdataobjects.IfObjectSizeisselected,thisfigureindicatesthedataobjects'sizeinbytescomparedtothetotalbytesizeofthedataobjects.

Note:WhenyouselectoneoftheDataSourceType,ObjectCount,orSlice&Diceoptions,thatoptioniscoloredbluewithintheuserinterface.

Parenttopic:Editingthesummaryofabox

RelatedtasksEditingthesummaryofabox

IBMUnstructuredData751, p. 576

Page 586: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ViewingthefilelistordatamapThefilelistanddatamaphelpsyoutoexploreyourdata,itsdetails,andrelationships.

AboutthistaskNote:SwitchbetweenthefilelistandthedatamapbyclickingtheListorMaptabs.Aselected,activetabisblue.

Toviewabox'sfilelistordatamap:

Procedure1. Withinthematter'sbox,clickFileListintheSummaryarea.

Note:TheFileListlinkisdisabledwhentheboxisinapendingstate.

TheSettingsareadepictsselectionsthatareenteredduringboxcreation.Thefoursubtabs,thatis,WhereandWhen,Who,Terms,andNotes,allappearasheadingswithintheSettingsarea.

TheFileListareashowsinformationaboutthebox'sdataobjects,includingtheName,FileSize,FilePath,Createddateandtime,andtheLastModifieddateandtime.Toviewaparticularobject,clicktheobject'snameanditopensintheDataObjectViewerpage.

a. Inabox'sFileList,clickthenameofthedataobjectyouwouldliketoview.ThedataobjectappearsintheDataObjectViewer.

b. Movefromoneobjecttothenextorwithintheobjectitselfusingthenavigationoptionsatthetopoftheviewer.

c. ClosetheDataObjectViewerbyclickingClose.2. Alternately,withinthematter'sbox,clickDataMapintheSummaryarea.

Note:TheDataMaplinkisdisabledwhentheboxisinapendingstate.ThedatamapisidenticaltothedatamapinIBM®StoredIQDataWorkbench.Withinthedatamap,youcanexploreyourdatatobetterunderstanditanditsdetails.

Parenttopic:Editingthesummaryofabox

RelatedtasksEditingthesummaryofabox

IBMUnstructuredData751, p. 577

Page 587: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ActionsonaboxWhenanIdentificationBoxiscreated,multipleactionsareavailabletohelpyoucategorizeandmovedataobjectsaspartofthee-discoveryprocess.

TheseboxactionsareavailableintheAvailableActionsarea:

RefinethisboxRestartthisboxCreateanewboxbasedonthisboxCreateaCollectionBoxbasedonthisboxCreateanExportBoxbasedonthisboxClonethisboxRunareportonthisboxDeletethisbox

RefiningaboxAfteraboxiscreated,itcanberefinedbychangingthescopeofthebox.Thisrevisionmodifiesthebox'sparameters.RestartingaboxIfaboxundergoesseveralrevisions,itisnecessarytorestartthebox.CloningaboxCreatedboxescanbeclonedtocreateother,identicalboxes.CreatingacollectionboxCollectionboxescanbecreatedwithanotherbox'soriginalsettings.CreatinganexportboxExportboxescanbecreatedwithanotherbox'soriginalsettings.ReportsIBM®StoredIQeDiscoveryprovidesvarioustypesofreports.RunningareportonaboxFollowthisproceduretorunvarioustypesofreports.DeletingaboxBoxesthatarenolongerneededwithinamattercanbedeleted.

IBMUnstructuredData751, p. 578

Page 588: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

RefiningaboxAfteraboxiscreated,itcanberefinedbychangingthescopeofthebox.Thisrevisionmodifiesthebox'sparameters.

Procedure1. Selecttheboxthatyouwanttorefine,andthenclicktheRefinethisboxlinkinthe

AvailableActionsarea.TheRefineBoxdialogboxappears.TherearefoursubtabsintheRefineBoxdialogbox:WhereandWhen,Who,Terms,andNotes.

2. WithintheWhereandWhensubtab,completethesefields.a. IntheFilelocalecheckboxes,selectatleastonelocaleforthisbox.Optionsinclude

FileShares,Emails,Desktops,andCollaboration.b. IntheTimeintervalarea,usethelistandenterthestartandenddatesforwhich

thisboxmustberevised.c. ClickNexttoaccesstheWhosubtab.

3. WithintheWhosubtab,completethefollowingfields.Bydefault,thefieldsarepopulatedwithcurrentcustodianselections.a. Selectidentitiestoactascustodiansforthebox.UseAddandRemovetomove

custodiansfromtheAllIdentitieslisttotheCurrentBoxCustodianslist.Note:Searchforaspecificidentitybyenteringalloraportionoftheuser'snameintheEnterterms...textboxandclickingSearch.

b. SelectAllIdentitiesorAllIdentities.ThevalueisaBooleanAND/ORvalue.Note:IfyouchangetheAllIdentities/AllIdentitiessetting,youmightobtainunexpectedresults.

c. ClickNexttoaccesstheTermssubtab.4. WithintheTermssubtab,completethefollowingfields.Bydefault,thefieldsare

populatedwithcurrentmatter-termselections.a. IntheEntertermandclickAddtextbox,enterthewantedlitigationterm,andthen

clickAdd.b. SelecteitherAnyTermorAllTerm.ThisvalueisaBooleanAND/ORvalue.

Note:IfyouchangetheAnyTerm/AllTermssetting,youmightobtainunexpectedresults.

c. UseDeleteandDeleteAlltoremoveaddedlitigationterms.d. ClickNexttoaccesstheNotessubtab.

5. WithintheNotessubtab,completethesefields.a. IntheNotestoDataExperttextbox,enterinstructionalinformationforthebox's

dataexpert.Note:Thistextboxhasalimitof2,000characters.

6. ClickFinish.TheboxisnowinaPendingstateontheMatterOverviewpage.

Parenttopic:Actionsonabox

RelatedconceptsActionsonabox

IBMUnstructuredData751, p. 579

Page 589: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

RestartingaboxIfaboxundergoesseveralrevisions,itisnecessarytorestartthebox.

Procedure1. Selecttheboxthatyouwanttorestart,andthenclicktheRestartthisboxlinkinthe

AvailableActionsarea.TheRestartBoxdialogboxappears.TherearefoursubtabsintheRestartBoxdialogbox:WhereandWhen,Who,Terms,andNotes.

2. WithintheWhereandWhensubtab,completethefollowingfields.Bydefault,thedatesthatareenteredduringboxcreationpopulatethisbox.a. IntheFilelocalecheckboxes,selectatleastonelocaleforthisbox.Optionsinclude

AllUserData,FileShares,Emails,Desktops,andCollaboration.b. IntheTimeintervalarea,usethelistandstartandenddatesforwhenthisbox

mustberestarted.c. ClickNexttoaccesstheWhosubtab.

3. WithintheWhosubtab,completethefollowingfields.Bydefault,thefieldsarepopulatedwithcurrentcustodianselections.a. Selectidentitiestoactascustodiansforthebox.UseAddandRemovetomove

custodiansfromtheAllIdentitieslisttotheBoxCustodianslist.Note:Searchforaspecificidentitybyenteringalloraportionoftheuser'snameintheEnterterms...textboxandclickingSearch.

b. SelectAllIdentitiesorAllIdentities.ThisvalueisaBooleanAND/ORvalue.Note:IfyouchangetheAllIdentities/AllIdentitiessetting,youmightobtainunexpectedresults.

c. ClickNexttoaccesstheTermssubtab.4. WithintheTermssubtab,completethefollowingfields.Bydefault,thefieldsare

populatedwithcurrentmatter-termselections.a. IntheEntertermandclickAddtextbox,enterthewantedlitigationterm,andthen

clickAdd.b. SelecteitherAnyTermorAllTerm.ThisvalueisaBooleanAND/ORvalue.

Note:IfyouchangetheAnyTerm/AllTermssetting,youmightobtainunexpectedresults.

c. UseDeleteandDeleteAlltoremoveaddedlitigationterms.d. ClickNexttoaccesstheNotessubtab.

5. WithintheNotessubtabintheNotestoDataExperttextbox,enterinformationforthebox'sdataexpert.Note:Thistextboxhasalimitof2,000characters.

6. ClickFinish.TheboxisnowinaPendingstateontheMatterOverviewpage.

Parenttopic:Actionsonabox

RelatedconceptsActionsonabox

IBMUnstructuredData751, p. 580

Page 590: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

CloningaboxCreatedboxescanbeclonedtocreateother,identicalboxes.

AboutthistaskNote:Whenyouarecloningabox,thesettingsandvaluesoftheoriginal'sboxareusedtoprepopulatethevaluesoftheclonedbox.

Procedure1. Selecttheboxthatyouwanttoclone,andthenclicktheClonethisboxlinkinthe

AvailableActionsarea.TheCloneIdentificationBoxdialogboxappears.TherearefivesubtabsintheCloneIdentificationBoxdialogbox:BaseInformation,WhereandWhen,Who,Terms,andNotes.

2. WithintheBaseInformationsubtab,completethesefields.a. IntheBaseNametextbox,enterthenametobeusedfortheboxanditsoutputs.b. IntheDescriptiontextbox,enterabriefdescriptionofthebox.c. ClickNexttoaccesstheWhereandWhensubtab.

3. WithintheWhereandWhensubtab,completethesefields:a. IntheFilelocalecheckboxes,selectatleastonelocaleforthisbox.Optionsinclude

AllUserData,FileShares,Emails,Desktops,andCollaboration.b. IntheTimeintervalarea,usethelistandenterthestartandenddatesforwhich

thisboxmustberevised.c. ClickNexttoaccesstheWhosubtab.

4. WithintheWhosubtab,completethesefields.Bydefault,thefieldsarepopulatedwithcurrentcustodianselections.a. Selectidentitiestoactascustodiansforthebox.UseAddandRemovetomove

custodiansfromtheAllIdentitieslisttotheCurrentBoxCustodianslist.Note:Searchforaspecificidentitybyenteringalloraportionoftheuser'snameintheEnterterms...textboxandclickingSearch.

b. SelectAllIdentitiesorAllIdentities.ThisvalueisaBooleanAND/ORvalue.Note:IfyouchangetheAllIdentities/AllIdentitiessetting,youmightobtainunexpectedresults.

c. ClickNexttoaccesstheTermssubtab.5. WithintheTermssubtab,completethefollowingfields.Bydefault,thefieldsare

populatedwithcurrentmatter-termselections.a. IntheEntertermandclickAddtextbox,enterthewantedlitigationterm,andthen

clickAdd.b. SelecteitherAnyTermorAllTerm.ThisvalueisaBooleanAND/ORvalue.

Note:IfyouchangetheAnyTerm/AllTermssetting,youmightobtainunexpectedresults.

c. UseDeleteandDeleteAlltoremoveaddedlitigationterms.d. ClickNexttoaccesstheNotessubtab.

6. WithintheNotessubtab,completethesefields.a. IntheNotestoDataExperttextbox,enterinformationforthebox'sdataexpert.

Note:Thistextboxhasalimitof2,000characters.7. ClickFinish.TheboxisnowinaPendingstateontheBoxesandReportspage.

Parenttopic:Actionsonabox

RelatedconceptsActionsonabox

IBMUnstructuredData751, p. 581

Page 591: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

CreatingacollectionboxCollectionboxescanbecreatedwithanotherbox'soriginalsettings.

AboutthistaskNote:Whenyouarecreatingaboxthatisbasedonanotherbox,thesettingsandvaluesoftheoriginal'sbox'sareusedtoprepopulatethecollectionbox'svalues.

Procedure1. Selecttheboxfromwhichyouwanttocreateacollectionbox,andthenclicktheCreateaCollectionBoxbasedonthisboxlinkintheAvailableActionsarea.TheCreateCollectionBoxdialogboxappears.TherearetwosubtabsintheCreateCollectionBoxdialogbox,BaseInformationandNotes.

2. WithintheBaseInformationsubtab,completethesefields.a. IntheBaseNametextbox,enterthenametobeusedfortheboxanditsoutputs.b. IntheDescriptiontextbox,enterabriefdescriptionofthebox.c. ClickNexttoaccesstheNotessubtab.

3. WithintheNotessubtab,completethesefields.a. IntheNotestoDataExperttextbox,enterinformationforthebox'sdataexpert.Note:Thistextboxhasalimitof2,000characters.

4. ClickFinish.TheboxisnowinaPendingstateontheMatterOverviewpage.

Parenttopic:Actionsonabox

RelatedconceptsActionsonabox

IBMUnstructuredData751, p. 582

Page 592: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

CreatinganexportboxExportboxescanbecreatedwithanotherbox'soriginalsettings.

Procedure1. Selecttheboxfromwhichyouwanttocreateanexportbox,andthenclicktheCreatean

ExportBoxbasedonthisboxlinkintheAvailableActionsarea.TheCreateExportBoxdialogboxappears.TherearetwosubtabsintheCreateExportBoxdialogbox,BaseInformationandNotes.

2. WithintheBaseInformationsubtab,completethesefields.a. IntheBaseNametextbox,enterthenametobeusedfortheboxanditsoutputs.b. IntheDescriptiontextbox,enterabriefdescriptionofthebox.c. ClickNexttoaccesstheNotessubtab.

3. WithintheNotessubtabintheNotestoDataExperttextbox,enterinformationforthebox'sdataexpert.Note:Thistextboxhasalimitof2,000characters.

4. ClickFinish.TheboxisnowinaPendingstateontheMatterOverviewpage.

Parenttopic:Actionsonabox

RelatedconceptsActionsonabox

IBMUnstructuredData751, p. 583

Page 593: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ReportsIBM®StoredIQeDiscoveryprovidesvarioustypesofreports.

ThefollowingtabledescribesallofthereporttypesthatyoucancreatewithinIBMStoredIQeDiscovery.

Table1.IBMStoredIQeDiscoveryreporttypesReportType Description

ComplianceReport

TheComplianceReportindicateswhetherdataisincompliancewithestablishedguidelines,specifications,orgovernancepolicies.Thegeneratedreportprovidesdetailedinformationaboutdata-objectcomplianceintheseareas:

ComplianceOverviewDistributionbyCategoryDistributionbyDataSourceDistributionbySizeofDataObjectDistributionbyDataOwnerDistributionbyLastModifiedDate

DataAssessmentReport

TheDataAssessmentReportassessesdataintermshowitinteractswithITpolicies.Thegeneratedreportprovidesdetailedinformationintheseareas:

DistributionbyDataSourceDistributionbySizeofDataObjectDistributionbyDataOwnerDistributionbyLastAccessedDateDistributionbyLastModifiedDateDistributionbyCategory

DataTopologyReport

TheDataTopologyReportdescribeshowdataisdistributedacrossyourorganization.Thegeneratedreportprovidesdetailedinformationintheseareas:

OverallSummaryDistributionbyDataSourceDistributionbyCategoryDistributionbyDataOwnerDistributionbyLastAccessedDateDistributionbyLastModifiedDate

OverlayHitReport

TheOverlayHitReportcomparesdata'sresponsivenessforvariousoverlays.Thegeneratedreportprovidesadetailedanalysisaboutoverlayinformationintheseareas:

OverlaySummaryOverlayResults

CSVExceptionsExportReport

TheCSVExceptionsExportReportliststheencounteredexceptions.Thegeneratedreportprovidesadetailedanalysisaboutexceptionsthataregeneratedduringanaction:

IDSourceObjectPathSourceObjectContainerPathSourceObjectNameSourceObjectVersionSourceObjectCreatedDateSourceObjectLastModifiedDate

IBMUnstructuredData751, p. 584

Page 594: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ExportReport SourceObjectLastModifiedDateDestinationObjectPathDestinationObjectContainerPathDestinationObjectNameDestinationObjectVersionDestinationObjectCreatedDateDestinationObjectLastModifiedDateCategoryToken

CSVInfosetDataObjectExportReport

TheCSVInfosetDataObjectExportReportliststhedataobjectswithinabox.Thegeneratedreportprovidesthefollowingcolumns:

NamePathContainerPathVolumeNameObjectTypeOwnerSizeCtimeMtimeAtimeHash

Parenttopic:Actionsonabox

RelatedconceptsActionsonabox

RelatedtasksDeletingabox

IBMUnstructuredData751, p. 585

Page 595: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

RunningareportonaboxFollowthisproceduretorunvarioustypesofreports.

Procedure1. Selecttheboxonwhichyouwanttorunareport,andthenclicktheRunareportonthis

boxlinkintheAvailableActionsarea.TheRunaReportBoxdialogboxappears.TherearetwosubtabsintheRunaReportBoxdialogbox,SelectReportandReportOptions.

2. WithintheSelectReportsubtab,selectthereportthatyouwanttorun.WhenareportisselectedintheSelectReportsubtab,detailsforthatreportappearwithinthedialogbox,includingthereport'snameanddescription.a. Searchforaspecificreportbyenteringalloraportionofthereport'snameinthe

Enterterms...textboxandclickingSearch.b. ClickNexttoaccesstheReportOptionssubtab.

3. WithintheReportOptionssubtab,completethesefields.a. IntheReportNametextbox,verifythatyouarerunningthewantedreport.Ifnot,

thisfieldcanbeedited,soyoucanenterthenameofthereportyouwanttorun.b. Tohaveanemailthatissentafterthereportiscomplete,selecttheSendanemail

whentheprocessiscompletecheckbox.Then,entertheemailaddressesoftheindividualstowhomthisreportissentintheEnternotificationemailstextbox.Note:Ifyouentermultipleemailaddresses,theymustbeseparatewithacomma.

4. ClickRuntorunthereport.TheboxrevertstothePendingstatewhenthereportisrunning.Whenthereportiscomplete,clickthereport'snameunderReports,thereportcanbeviewedfromtheuserinterface.

Parenttopic:Actionsonabox

RelatedconceptsActionsonabox

IBMUnstructuredData751, p. 586

Page 596: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DeletingaboxBoxesthatarenolongerneededwithinamattercanbedeleted.

Procedure1. Selecttheboxthatyouwanttodelete,andthenclicktheDeletethisboxlinkinthe

AvailableActionsarea.TheDeleteBoxConfirmationwindowappears.2. ClickOKtodeletethebox.Theboxisdeletedandremovedfromthematter.Itisno

longerseenwithintheMatterOverviewpage.Note:Deletingaboxdoesnotaffectanyboxesthatarecreatedwithitorclonedfromit.However,itsdeletionmeansthatitisnolongeravailabletocreatenewboxesorreports.

Parenttopic:Actionsonabox

RelatedconceptsActionsonabox

IBMUnstructuredData751, p. 587

Page 597: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ManagingIBMStoredIQPolicyManagerIBM®StoredIQPolicyManagerprovidesaninterfaceforyoutoviewavailablepolicies,create,edit,delete,orrunapolicyorareport.

ThefollowingtopicsdescribeindetailhowtouseIBMStoredIQPolicyManagertoactonpoliciesorreports.

OverviewofIBMStoredIQPolicyManagerIBMStoredIQPolicyManagerenablespolicyexecutionatscalewithinIBMStoredIQPlatform.IBMStoredIQPolicyManageradministrationIBMStoredIQPolicyManageradministrationdescribeshowtouseIBMStoredIQPolicyManagertomanagepolicies.

Parenttopic:ManagingtheIBMStoredIQproducts

IBMUnstructuredData751, p. 588

Page 598: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

OverviewofIBMStoredIQPolicyManagerIBM®StoredIQPolicyManagerenablespolicyexecutionatscalewithinIBMStoredIQPlatform.

TheIBMStoredIQpoliciessetrulesandcriteriaforthesystemtoactondata.Thepoliciesaredefinedbythesefactors:

Type:Thetypeofactionthattheuserwantsthesystemtoactuponthedata.Criteria:Well-definedexpressionsthatoutlineexactlywhatdataiseligibleforthepolicytoactupon.Scope:Amechanismtodefinewhatsetofdataistobeactedupon.Schedule:Ascheduletodefinewhenthesystemmustrunthepolicy.

IBMStoredIQPolicyManager'sreportsrecordwhatandwhencertainactionswerecompletedandwhatdatawasaffectedbythepolicy'sexecution.IBMStoredIQPolicyManagerprovidesthePolicyDashboard,whichprovidesavisualmeansfortheusertoquicklyfindandidentifythepolicytoworkon.ThePolicyDashboardhasthesefunctions:

Listsallpoliciesavailable.ThislistcanbesortedbytheCreatedDateofthePoliciesandcanbefilteredbyName.Showshigh-levelpolicydetails.Detailsincludepolicyname,description,createddate,numberofrunsassociatedwiththepolicy,theassignedpersonastothebox,anddetailsaboutthepolicy'stype,criteria,scope,andschedule.Allowsforpoliciestobeselectedforviewofdetailsofthespecificpolicies.Providesawaytocreateanewpolicy.Providesawaytoenableordisablethepolicyfromrunningonitsdefinedschedule.AllowsforpoliciestobedeletedfromthePolicyDashboard.

RelatedconceptsIBMStoredIQPolicyManageradministration

IBMUnstructuredData751, p. 589

Page 599: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

IBMStoredIQPolicyManageradministrationIBM®StoredIQPolicyManageradministrationdescribeshowtouseIBMStoredIQPolicyManagertomanagepolicies.

PolicyDashboardviewPolicyDashboardprovideshigh-levelinformationaboutapolicy,itsname,description,creationtime,creationdate,andwhetherthepolicyisturnedonoroff.Ithelpsyoutofindandidentifypoliciesofyourinterest.ActionsonapolicyWhenapolicyiscreated,multipleactionsareavailabletohelpyouactondataobjectsaspartofthepolicy-managementprocess.

RelatedconceptsOverviewofIBMStoredIQPolicyManager

IBMUnstructuredData751, p. 590

Page 600: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

PolicyDashboardviewPolicyDashboardprovideshigh-levelinformationaboutapolicy,itsname,description,creationtime,creationdate,andwhetherthepolicyisturnedonoroff.Ithelpsyoutofindandidentifypoliciesofyourinterest.

Youcanviewapolicy'sstatusonthePolicyDashboard,whichalsoprovidescriticalpiecesofinformationforeachpolicy.

Apolicy'sstate,itsname,description,andthedateandtimeatwhichitwascreatedWhetherthepolicyisOnorOffItsassignedactionWhenthepolicyisscheduledtorun,andwhatitrunsonnextWhatfiltersareusedTimeanddateofthepolicy'snextrunHowmanytimesthepolicyissuccessfullycompletedTheAdminandPolicyUserforthatpolicy.

FromthePolicyDashboard,youcanaccomplishthesetasks.

Viewapolicyindetailbyclickingthepolicythatyouwanttosee.EnableordisableapolicybyturningitOnorOff.ContacteithertheAdministratororPolicyUseraboutaspecificpolicybyclickingthatperson'sname.DeleteapolicybyclickingXwithinthepolicy.Searchforapolicybyfilteringtheexistingpolicies.CreateapolicybyclickingCreatePolicy.

Table1.PolicyManager:PolicyDashboardOptionsandDescriptionsOption Description

Icon.

Aniconisdisplayedtotheleftofthepolicyname,indicatingitsstatus:

ActiveAnactivepolicyiscorrectlyconfiguredandreadytostartanydefinedscheduledandrecurringruns.YoucanalsousetheRunNowoption.

PendingApendingpolicyisincompleteandnotyetavailableforexecution.

FailedAfailedpolicyisonethatfailedcreationandisnotavailableforuse.

Name Nameofthepolicy.Created Timeanddateatwhichthepolicywascreated.

On/Off

Indicateswhetherapolicyisenabledordisabled.

IfOnisblue,thepolicyisenabledandavailableforuse.IfOffisblue,thepolicyisdisabledandunavailableforuse.

ClickOnorOfftoturnthepolicyOnorOff.

Action

Theactionthatthepolicytakes.

AutomatedDeletionDeletesfilesonanautomatedschedule.Thispolicyalsohasamanualoption.

When Thepolicy'sexecutionschedule.Specifically,itlistswhetherthepolicyrunsdaily,weekly,ormonthly,onwhatday,andatwhattime.

What Whatinfosetisusedaspartofthispolicy'sexecution.Filter Whatfilterisusedaspartofthispolicy'sexecution.

NextRun Thetimeanddateatwhichthepolicyrunsnexttime.

IBMUnstructuredData751, p. 591

Page 601: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Complete Thenumberoftimesthatthepolicycompleteditsexecution.

Admin Thepolicy'sadministratorislistedhere.Toemailthisindividual,clickthename.

Policyuser Thepolicyuserislistedhere.Toemailthisindividual,clickthename.

CreatingapolicyYoucancreatepoliciesfromthePolicyDashboard.ViewingapolicyYoucanviewthecontentsofanexistingpolicy,includinganabbreviateddashboard,itsruns,reports,andavailableactionsbyaccessingthepolicyitself.EnablingordisablingapolicyWithinIBMStoredIQPolicyManager,enabledpoliciesmeanthattheyareavailableforuse,whiledisabledpoliciesareunavailableforuse.EmailingacontactpersonYoucanemailacontactpersonofapolicybyclickingthenameofthatpersononthePolicyDashboard.DeletingapolicyDeletingapolicydeletesallpendingandcompletedrunsofthatpolicyanditsreports.

Parenttopic:IBMStoredIQPolicyManageradministration

RelatedconceptsIBMStoredIQPolicyManageradministration

IBMUnstructuredData751, p. 592

Page 602: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

CreatingapolicyYoucancreatepoliciesfromthePolicyDashboard.

Procedure1. FromthePolicyDashboardscreen,clickCreatePolicy.TheCreatePolicydialogbox

appears.2. SelecttheAutomatedDeletionaction(itistheonlyavailableaction)forthepolicy,and

thenclickNext.Whenanactionisselectedforthepolicy,theCreatePolicydialogboxshowsfourfields:

BaseInformationWhatFilterWhen

3. IntheBaseInformationtab,completetheseoptions.a. IntheNametextbox,enterauniquenameforthispolicy.b. Optional:IntheDescriptiontextbox,enteradescriptionofthispolicy.c. IntheAdminContactlist,selecttheindividualthatactsastheadministrative

contactforthispolicy.TheusersinthislistarepopulatedfromtheIBM®StoredIQAdministratorusermanagementfeature.

d. InthePolicyContactlist,selecttheindividualthatactsasthepolicyusercontactforthispolicy.TheusersinthislistarepopulatedfromtheIBMStoredIQAdministratorusermanagementfeature.

e. ClickNext.4. IntheWhattab,selecttheinfosetforthepolicyrun.Ifneeded,enterthenameofthe

infosetintheEnterterms...textboxandthenclickSearchtofiltertheinfosets.AdministratorscanbuildmoreinfosetswithIBMStoredIQAdministrator.

5. ClickNext.6. IntheFiltertab,selectafilterforthepolicy.Ifneeded,enterthenameofthefilterinthe

Enterterms...textboxandthenclickSearchtosearchtheinfosets.AdministratorscanbuildmorefilterswithIBMStoredIQDataWorkbench.

7. ClickNext.Note:ViewthefilterssourcecodebyclickingViewSourceCode.Aseparatedialogwindowopens,showingtheattributesthatareusedtobuildtheselectedfilter.

8. IntheWhentab,setthetimeanddatewhenthepolicyruns.SelecteitherOnetimeorRepeating.a. IfyouselecttheOnetimeoption,completetheOnandAttextboxes.Selectthedate

andtimeonwhichthepolicyruns.b. IfyouselecttheRecurringoption,selecteithertheWeeklyorMonthlylistoption,its

frequency,andtheday,time,andstartdatesthepolicyruns.9. ClickFinish.ThenewlycreatedpolicyappearsintheRunsandReportsareaofthePolicy

Dashboardandreflectsthevaluessetduringthepolicycreation.

Parenttopic:PolicyDashboardview

RelatedconceptsPolicyDashboardview

IBMUnstructuredData751, p. 593

Page 603: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ViewingapolicyYoucanviewthecontentsofanexistingpolicy,includinganabbreviateddashboard,itsruns,reports,andavailableactionsbyaccessingthepolicyitself.

Procedure1. WithinthePolicyDashboard,clickthepolicythatyouwanttoview.Thepolicyopens

withinthePolicyViewpage.2. WithinthePolicyViewpage,theseareascanbeseen.

Table1.PolicyViewpagerunsoptionsanddescriptionsRunOption Description

Name Nameofthepolicy,whichwasconfiguredduringthepolicycreation.Started Starttimeanddateatwhichthepolicywaslastrun.

Type

Typeofthepolicy'srun:

RunNowTheRunNowiconindicatesthatapolicyrunsimmediatelywhenRunNowisclicked.

RecurringTheRecurringiconindicatesthatapolicyisscheduledtorunmanytimes.

ScheduledTheSchedulediconindicatesthatapolicyisscheduletorunonetime.

Status

Policy'sstatusaboutitsrun.

CompletedThepolicycompleteditsrunsuccessfully.

QueuedThepolicyisscheduledtorunandisqueuedtodoso.

FailedThepolicyfaileditsrun.

Table2.PolicyViewSummaryOptionsandDescriptionsSummaryOption Description

Name Nameofthepolicy,whichwasconfiguredduringthepolicycreation.Type Typeofthepolicy'srun.Description Descriptionofthepolicy.Started Starttimeanddateatwhichthepolicywaslastrun.Duration Durationofthepolicy'smostrecentexecution.

Table3.PolicyViewReportOptionsandDescriptionsReportOptions Descriptions

Name Nameofthereport.Created Timeanddatethatthereportwascreated.Status Reportstatus.OptionsincludeReportprocessing,Success,andFailed.

Table4.PolicyViewAvailableActionsandDescriptionsAvailableActionOptions

Descriptions

Availableactions:

Runnow

IBMUnstructuredData751, p. 594

Page 604: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

Action

RunnowByclickingthisoption,theselectedpolicyrunswhenitisavailableinthequeue.

ExecuteCSVexceptionreportonrunByclickingthisoption,theCSVExceptionReportcanbecreated.

DeletetherunByclickingthisoption,theselectedrunalongwithitsassociatedpendingandcompletedreportsisdeleted.

3. ClickthePolicyDashboardlinkwithinthebreadcrumbtrailtoreturntothePolicyDashboard.

Parenttopic:PolicyDashboardview

RelatedconceptsPolicyDashboardview

IBMUnstructuredData751, p. 595

Page 605: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

EnablingordisablingapolicyWithinIBM®StoredIQPolicyManager,enabledpoliciesmeanthattheyareavailableforuse,whiledisabledpoliciesareunavailableforuse.

AboutthistaskToenableordisableapolicy:

ProcedureInthePolicyDashboard,locatethepolicythatyouwanttoenableordisable.

a. Toenableapolicy,clickOn.Verifythatitisblue.Thepolicyisnowavailableforuse.b. Todisableapolicy,clickOff.Verifythatitisblue.Thepolicyisnowunavailableforuse.

Parenttopic:PolicyDashboardview

RelatedconceptsPolicyDashboardview

IBMUnstructuredData751, p. 596

Page 606: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

EmailingacontactpersonYoucanemailacontactpersonofapolicybyclickingthenameofthatpersononthePolicyDashboard.

AboutthistaskToemailacontactpersonofapolicyfromthePolicyDashboard:

Procedure1. Findthepolicythatcontainsthecontactpersonyouwanttoemail.2. ClickthenameoftheAdminorPolicyUserthatyouwanttoemail.Anemailtothat

individualautomaticallyopensinyouremailclientwiththenameofthematterasthesubjectoftheemail.

Parenttopic:PolicyDashboardview

RelatedconceptsPolicyDashboardview

IBMUnstructuredData751, p. 597

Page 607: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DeletingapolicyDeletingapolicydeletesallpendingandcompletedrunsofthatpolicyanditsreports.

Procedure1. OnthePolicyDashboard,selectthepolicythatyouwanttodelete.2. ClickXintherightcornerofthatselectedpolicy.TheDeletePolicyconfirmationdialog

appears.Note:Ifyoudeletethepolicy,allofthependingandcompletedpolicyrunsanditsreportsaredeleted.

3. IntheDeletePolicyconfirmationdialog,clickDelete.

Parenttopic:PolicyDashboardview

RelatedconceptsPolicyDashboardview

IBMUnstructuredData751, p. 598

Page 608: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ActionsonapolicyWhenapolicyiscreated,multipleactionsareavailabletohelpyouactondataobjectsaspartofthepolicy-managementprocess.

TheseactionsareavailableintheAvailableActionsarea:

RunnowByclickingthisoption,theselectedpolicycanberunafteritisavailableinthequeue.

ExecuteCSVexceptionreportonrunByclickingthisoption,theCSVExceptionListReportcanbecreated.

DeletetherunByclickingthisoption,theselectedrunalongwithitsassociatedpendingandcompletedreportsisdeleted.

Additionally,youcanalsoeditapolicybyclickingEditPolicy.

EditingapolicyEditingapolicyissimilartocreatingpolicyinthewaythatyoucanmodifyanyofthefieldsduringediting.RunningapolicyFollowthesestepstorunapolicy.RunningareportToworkwiththeIBMStoredIQpolicies,youcangeneratereports.ViewingapolicyreportYoucanviewExecuteCSVexceptionreportonrunasa.CSVfile.DeletingarunPolicyexecutionsandtheirassociatedreportscanbedeleted.StoppingarunYoucanstoppoliciesthatarecurrentlybeingrun.However,actionsthatarealreadystartedbytherunpersistandtheruncannotberestarted.

Parenttopic:IBMStoredIQPolicyManageradministration

RelatedconceptsIBMStoredIQPolicyManageradministration

IBMUnstructuredData751, p. 599

Page 609: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

EditingapolicyEditingapolicyissimilartocreatingpolicyinthewaythatyoucanmodifyanyofthefieldsduringediting.

Procedure1. InthePolicyViewscreen,clickEditPolicywithinthePolicyDashboard.TheEditPolicy

dialogboxappears.2. Editthefieldsofthepolicyduringthepolicycreation.

Parenttopic:Actionsonapolicy

RelatedconceptsActionsonapolicy

IBMUnstructuredData751, p. 600

Page 610: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

RunningapolicyFollowthesestepstorunapolicy.

Procedure1. InthePolicyViewscreen,clickRunNow.TheRunPolicydialogboxappears.2. IntheRunPolicydialogbox,enterabasenameandadescriptionforthepolicyrun.This

basenameisusedtonametheboxanditsreports.3. ClickRun.

Parenttopic:Actionsonapolicy

RelatedconceptsActionsonapolicy

IBMUnstructuredData751, p. 601

Page 611: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

RunningareportToworkwiththeIBM®StoredIQpolicies,youcangeneratereports.

Procedure1. IntheAvailableActionsarea,selectExecuteCSVexceptionreportonrun.TheRun

ExceptionReportdialogboxappears.2. Inthedialogbox,completethesefields.

a. TheNametextboxisauto-filled,butthereportnamecanbeeditedorchangedbyenteringyourtextintotheNametextbox.

b. Tosendthegeneratedreporttodifferentemailaddresses,selecttheSendanemailwhentheprocessiscompletecheckbox.

c. IntheEnternotificationemailstextbox,entertheemailaddressestowhichthegeneratedreportissent.

3. ClickRun.

Parenttopic:Actionsonapolicy

RelatedconceptsActionsonapolicy

IBMUnstructuredData751, p. 602

Page 612: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

ViewingapolicyreportYoucanviewExecuteCSVexceptionreportonrunasa.CSVfile.

Procedure1. InthePolicyViewwindow,selecttherunforwhichyouwanttoviewthereport.2. IntheReportsarea,clickthereportthatyouwanttoview.Afolderdownloads.

Note:OnlyreportsintheCompletedstatecanbeviewed.3. Clickthefolderandthenopenthe.CSVfiletoviewthereport.

Parenttopic:Actionsonapolicy

RelatedconceptsActionsonapolicy

IBMUnstructuredData751, p. 603

Page 613: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

DeletingarunPolicyexecutionsandtheirassociatedreportscanbedeleted.

Procedure1. IntheAvailableActionsarea,clickDeleterun.TheDeleteRunconfirmationappears,

verifyingthatyouwanttodeletetheselectedrunalongwithitsassociatedpendingandcompletedreports.

2. ClickDelete.

Parenttopic:Actionsonapolicy

RelatedconceptsActionsonapolicy

IBMUnstructuredData751, p. 604

Page 614: IBMpublic.dhe.ibm.com/support/knowledgecenter/StoredIQ/... · 2019. 12. 12. · Getting started Overview of the IBM StoredIQ components Deployment of IBM StoredIQ Platform IBM StoredIQ

StoppingarunYoucanstoppoliciesthatarecurrentlybeingrun.However,actionsthatarealreadystartedbytherunpersistandtheruncannotberestarted.

Procedure1. ClickStop.TheStopRunconfirmationboxappears.2. ClickStop.

Parenttopic:Actionsonapolicy

RelatedconceptsActionsonapolicy

IBMUnstructuredData751, p. 604