information lifecycle dhawal himani & hitasha
TRANSCRIPT
-
8/8/2019 Information Lifecycle Dhawal Himani & Hitasha
1/23
An Oracle White Paper
June 2007
Information Lifecycle Management for
Business Data
Presentation by:
Dhawal Kirti Maheshwari
Himani Garkoti
Hitasha Goswami
-
8/8/2019 Information Lifecycle Dhawal Himani & Hitasha
2/23
Introduction
eptember 28, 2010 Information Lifecycle Management for Business Data 2
There are 2 objectives IT managers are trying to satisfy:
To store vast quantities of data, for the lowest possible cost
To meet the new regulatory requirements for data retention
and protection.
-
8/8/2019 Information Lifecycle Dhawal Himani & Hitasha
3/23
What is ILM?
y Information Lifecycle Management (ILM) is designed to
address these issues, with a combination of processes,
policies, software and hardware so that the appropriate
technology can be used for each phase of the lifecycle of the
data.
September 28,
20103
Information Lifecycle Management for Business Data
-
8/8/2019 Information Lifecycle Dhawal Himani & Hitasha
4/23
The lifecycle of data
y Active
y Less active
yHistorical
y Archive
S
eptember 28, 20104
Information Lifecycle Management for Business Data
-
8/8/2019 Information Lifecycle Dhawal Himani & Hitasha
5/23
Why Oracle database 11g for
business ILM
It is much easier to manage, because the data is all in one
place, instead of being stored using many different formats.
the Oracle database is the ideal platform to implement an
Information Lifecycle Management policy, because it has anumber of features, which makes it very easy to implement
an ILM solution:
Application Transparency; data classification is transparent
Fine-grained; managing data at individual row level
Low-Cost; uses low cost to reduce costs
Enforceable Compliance Policies; define and enforce policies
September 28,
2010 5Information Lifecycle Management for Business Data
-
8/8/2019 Information Lifecycle Dhawal Himani & Hitasha
6/23
y Application Transparency is very important in ILM, because itmeans that there is no need to customize applications and it
also allows various changes to be made to the data without any
impact on the applications that are using that data.
y fine-grained levely low cost storage
y compliance reasons
September 28,
20106
Information Lifecycle Management for Business Data
-
8/8/2019 Information Lifecycle Dhawal Himani & Hitasha
7/23
Implementing Information Lifecycle
Management
Step1. Step 2. Step 3. Step 4.
Define the
dataclasses
Create
storage
tiers fordata
classes
Create
data
access &migration
policies
Define &
enforce
compliance policies
September 28,
2010 7Information Lifecycle Management for Business Data
-
8/8/2019 Information Lifecycle Dhawal Himani & Hitasha
8/23
Step1-Define the data classes
Determine the following while defining the data classes:
y Which data is important, where is it and what needs to be
retained.
yHow this data flows within the organization.
y What happens to this data over time and is it still needed.
y The degree of data availability and protection that is needed.
y Data retention for legal and business requirements.
September 28, 20108
Information Lifecycle Management for Business Data
-
8/8/2019 Information Lifecycle Dhawal Himani & Hitasha
9/23
Step1-Define the data classes
Data canbe bytheir ageor dateor both
Classification
Data hasto bephysicallyseparated
Separation
Data has
to begroupedat rowleveldepending ontheir class
Grouping
tember 28, 2010 9Information Lifecycle Management for Business Data
-
8/8/2019 Information Lifecycle Dhawal Himani & Hitasha
10/23
Example of defining data classes
S
eptember 28, 201010
Information Lifecycle Management for Business Data
-
8/8/2019 Information Lifecycle Dhawal Himani & Hitasha
11/23
Step2- Create storage tiers for data
classes
It is required toremove data fromdatabase & store it inother format
All the data that isnever or hardlyaccessed would bestored.
The less frequentlyaccessed data is stored,eg orders for Q2,Q3 and Q4.
All the importantand frequentlyaccessed data isstored, eg
Q1 orders.
Highperformancestorage tier
Low coststorage tier
Offlinearchive
storage tier
Onlinearchive
storage tier
tember 28, 201011
Information Lifecycle Management for Business Data
-
8/8/2019 Information Lifecycle Dhawal Himani & Hitasha
12/23
Step2- Create storage tiers for data
classes
y The cost will be saved resulting from the usage of multiple tiered
storage.
y Once the storage tiers have been defined the data classes
(partitions) identified in step one can be assigned to theappropriate storage tiers.
y The data is distributed across the appropriate storage devices
depending on its usage, while still keeping the data online and
readable available and stored on the most cost-effective device.
y Since partitioning is completely transparent to anyone accessing
the data, no applications changes are required, thus it can be
implemented at any time at minimal cost.
S
eptember 28, 2010 12Information Lifecycle Management for Business Data
-
8/8/2019 Information Lifecycle Dhawal Himani & Hitasha
13/23
Step 3 Create Data Access and
Migration PoliciesManaging Access to Data
y By Using Oracle Database 11g asecurity policy is implemented viavirtual private database thatdetermines exactly which data canbe seen, therefore authorized users
could see the information for Q1,Q2, Q3 and Q4, but only specialusers could view the historical data.
y A security policy is defined at thedatabase level and it is transparentlyapplied to all database users.
yThe benefit of this approach is thatit provides a secure and controlledenvironment for accessing the data,which cannot be overridden andcan be implemented withoutrequiring any application changes.
y Migrate Data between Classes
y During the lifecycle of the data itwill be necessary to move it atvarious times .
y Within Oracle Database 11g, there
are a number of ways that data canbe physically moved within thedatabase to take advantage of thedifferent storage tiers
y Sometimes individual data itemsmust be moved rather than a groupof data.
eptember 28, 201013
Information Lifecycle Management for Business Data
-
8/8/2019 Information Lifecycle Dhawal Himani & Hitasha
14/23
Step 4 Define and Enforce
Compliance Policiesy Defining compliance policies for data which is stored at one central
location in oracle database is easier.
y The following areas are to considered while defining the compliance
policies.
Retention
( for how long the datahas to be kept)
Immutability
(assigning an externalparty that data is
complete & it has notbeen altered)
Privacy
(security policies aredefined using virtual
private database)
Auditing
(Oracle database hasauditing capabilities to
track all access andchanges to data)
Expiration
(oracle database removedata very quickly by
dropping the partitions)
September 28, 201014
Information Lifecycle Management for Business Data
-
8/8/2019 Information Lifecycle Dhawal Himani & Hitasha
15/23
S
eptember 28, 2010 Information Lifecycle Management for Business Data15
GUI based tool.
Used for managingILM environment
Oracle ILM
Assistant
-
8/8/2019 Information Lifecycle Dhawal Himani & Hitasha
16/23
Basic Requirements:
September 28,
2010 Information Lifecycle Management for Business Data16
y Oracle Database 9i or greater
y
OracleA
pplication Express must be installed in thedatabase where the tables reside
-
8/8/2019 Information Lifecycle Dhawal Himani & Hitasha
17/23
September 28, 2010 Information Lifecycle Management for Business Data 17
y ILM Assistant provides the ability to create lifecycle definitions.
y These definitions are assigned to tables in the database.
y Then based on the lifecycle policy, the ILM Assistant advises when it is
time to move, archive or delete data.
y The storage requirements and cost savings associated with moving the
data is also illustrated.
y Other capabilities include the ability to show how to partition a table
based on a lifecycle definition and to simulate the events on a table if it
were partitioned.y To assist with managing compliance issues, the ILM Assistant will show
all VPD and FGA policies that have been defined. It can also display and
query all the audit records and generate and compare digital signatures.
Features:
-
8/8/2019 Information Lifecycle Dhawal Himani & Hitasha
18/23
September 28, 2010 Information Lifecycle Management for Business Data
18
TraditionalView
Data should be removed from the database and stored on tape,because tapes are capable of storing vast quantities ofinformation for a very low cost
Data needs to be archived out of the database in order tomaintain the performance of the database
Reluctance in some organizations to remove data from the
database.
Modern View
Data can remain in the database, or transferred to a centralonline archive database. All this information would be storedusing low-cost storage devices
Databases can perform extremely well with huge quantities ofdata
if there is no legal requirement to retain the data, why keep itwhen it is no longer required
Online archives
-
8/8/2019 Information Lifecycle Dhawal Himani & Hitasha
19/23
Benefits of online archives
September 28, 2010 Information Lifecycle Management for Business Data 19
y Data will always be instantly available, therefore time is not wasted
trying to locate the tapes.
y No worrying as to whether the tape is readable and still in a
format that can be loaded into the database.y Retrieval of data from databases could prove expensive, and time-
consuming if the data is extremely old.
y Holding all the historical data in the database no longer impacts
the time required to backup the database and the size of the
backup.
y Data remains online when needed hence faster access to meet the
business requirements
-
8/8/2019 Information Lifecycle Dhawal Himani & Hitasha
20/23
Removal of data
September 28, 2010 Information Lifecycle Management for Business Data 20
Keep the data in its ownpartition and then dropthe partition when it is
time to remove that data
from the database.
Remove the data in a
database format such as atransportable tablespaceor extract the information
in an open format.
No legal
requirement
to retain the
data
Data may haveto be returned
to the database
in future
-
8/8/2019 Information Lifecycle Dhawal Himani & Hitasha
21/23
Conclusion
September 28, 2010 Information Lifecycle Management for Business Data 21
y Oracle Database 11g provides an ideal platform for
implementing ILM.
Simple to use since there are no specialized data stores to manage and it
operates independent of any hardware.
It has proven fast performance
The data is secure from unauthorized access and data is always
transactionally consistent.
-
8/8/2019 Information Lifecycle Dhawal Himani & Hitasha
22/23
tember 28, 2010 Information Lifecycle Management for Business Data 22
y The Oracle Database provides total flexibility
Can rapidly adapt to any change in requirements..
It is possible to define what should happen to data during its lifetime and
be reminded when it is time to perform those actions.
The Oracle Database has already been around for over 20 years, which is
very reassuring when your data may have to be retained for a long
duration.
-
8/8/2019 Information Lifecycle Dhawal Himani & Hitasha
23/23
tember 28, 2010Information Lifecycle Management for Business Data 23
y Information Lifecycle Management enables us to understand
our data, which is an extremely valuable business asset,which must be managed properly, to ensure business success
and regulatory compliance. Using Oracle Database 11g, a
comprehensive ILM solution can be implemented for the
lowest possible cost.