object storage
TRANSCRIPT
Object Storage
Seminar Guide:Mr: R.Anand
Mrs: G.Madhu
Prepared by:
Akash K TUSN:1CR11IS008
Department:
ISE
Agenda
i. Abstract
ii. Existing technologies
iii. Comparison
iv. Drivers for Object-based storage
v. What is object based storage 1.Object
2.OSD(Object storage device)
3.MDS(Metadata Server)
vi. Key components of OSD
vii. Process of storing object in OSD
viii. Process of retrieving object from OSD
ix. Key benefits of Object based storage
Abstract
• Object Storage is the new storage paradigm. There is a high level of interest from organizations, as this new approach resolves the challenges of efficiently storing massive volumes of unstructured data - Big Unstructured Data
Two Technologies:
• Files:– Flexible data sharing– Secure
• Blocks:– High performance– Scalable
Blocks
Files
Comparison
Block Based Disk Object Based Disk
Operations: Read block Write block
Addressing: Block range
Operations:Create object Delete object Read objectWrite object
Addressing: [object, byte range]
Objects can be regarded as the convergenceof two technologies: files and blocks
Drivers for Object-based Storage
More than 90% of the data being generated is unstructured
Traditional solutions are inefficient to handle the growth
Object-based storage provides a smarter approach to manage unstructured data based on content
what is object based storage?
a way to store file data in the form of objects on a flat address space based on its content and attributes rather than the name and location
components of object based storage
• Object• OSD(Object-based storage Device)• MDS(Metadata Server)
Object
• An object is a logical unit of storage—ID (Identification)—Application data— Metadata which includes block allocation and
length—Attributes that is accessible by users
• Objects have file-like methods— open, close, read, write
• The root object -- The OSD itself• User object -- Created by SCSI
commands from the application or client
• Collection object -- A group of user
objects, such as all .mp3• Partition object -- Containers that
share common security and space management characteristics
CPU
Applications
System Call Interface
File SystemUser Component
File SystemStorage Component
Block I/O Manager
Storage Device
CPU
Applications
System Call Interface
File SystemUser Component
Object Interface
Interface
Two changes :Object-based storage offloads the storage component to the storage deviceThe device interface changes from blocks to objects
(a)Traditional
model
(b)Object storage
model
Object Storage Devices
File SystemStorage Component
Block I/O Manager
Storage Device
Key components of OSD
IP internal network
Metadata service
Storage service
OSD node Storage
OSD nodesInternal networkStorage
Application server
OSD system
Process of storing object in OSD
Metadata service
1.Application server sends file to OSD
6.Acknowledgement sent to application server
5.OSD stores user data using user service
Application server
Storage service
OSD node
2.OSD node divides file into two parts metadata and user data
3. OSD node generates object ID from user data
4. OSD stores metadata and object ID using metadata service
storage
Process of retrieving object from OSD
Metadata service
Storage service
Storage
1.Application server request file from OSD
2.metadata service locates object ID for the requested file
3.Metadata service sends object ID to application server
4.Application server sends object ID to OSD storage service for object retrieval
6.Storage service sends the file to the application server
5.OSD storage service retrieves the object from storage device
Application server
Storage service
OSD node
Key Benefits of object-based storage
• Security and Reliability
• Platform independence
• Scalability
• Manageability