a profile on the grid data engine (griddaen)
DESCRIPTION
A Profile on the Grid Data Engine (GridDaEn). Xiao Nong Email: [email protected] www.griddaen.org www.datagrid.com.cn. GridDaEn Focus. Integration Integrate heterogeneous mass storage resources located in multiple domains Effective and secure data operations - PowerPoint PPT PresentationTRANSCRIPT
1School of Computer, National University of Defense Technology
A Profile on the Grid Data Engine (GridDaEn)
Xiao NongXiao NongEmail: [email protected]: [email protected]
www.griddaen.orgwww.datagrid.com.cn
2School of Computer, National University of Defense Technology
GridDaEn Focus
Integration Integrate heterogeneous mass storage resources located in multiple domains
Effective and secure data operations Access, storage, dispatch, replication, and movement
Transparent Federated services Name transparence Location transparence Protocol transparence Uniform access
3School of Computer, National University of Defense Technology
Data R
equest
Integrated Access Integrated Access and Processingand Processing
GridDaEn Overview
EnvironmentEnvironment EnvironmentEnvironment
NFSNFS CINFCINF
Data Center 1Data Center 1
OracleOracle FTPFTP
Data Center 2Data Center 2
NFSNFS XMLXML
Data Center nData Center n
NFSNFS
Providing
Providing
DataData
Publis
hing
Publis
hingData
Response
Deployment Deployment and and
ManagementManagement
4School of Computer, National University of Defense Technology
GridDaEn Architecture
Access interface layer ： Data service interfaces for gri
d users
System service layer ： Metadata service Data service Monitor service Security service …
Data operation layer ： Access interfaces to fabric sto
rage
MDIS(metadataInformati on
Server)
DRB(Data RequestBroker)
NFS CINF NFSUNIX
Appl i cati on(Gri dDaenCl i ent )
5School of Computer, National University of Defense Technology
GridDaEn ArchitectureClient
Uniform Operating Interface & Global Management
ResourceAggregator
Resource
InforService
Co-Scheduling
RequestD
ispatch
Rem
oteA
ccessing
Data
Transfer&
manipulation
Data
Replication
&C
aching
Data Service Metadata Service Security
Resource
Description
&publish
Data
Metadata
Access
&M
anagement
System
Metadata
Access
&M
anagement
Registry
&P
ublish
Replica
Managem
ent&
Selection
SystemManagement
Authentication
&A
uthorization
User
Mapping
Audit
User
Managem
ent
Configuration
Managem
ent
SystemM
onitor
ResourceAccess Interface
DatabaseAccess
Interface
MetadataAccess
Interface
File SystemAccess Interface
Oracle,SybaseUNIX, NT DB2
6School of Computer, National University of Defense Technology
GridDaEn Components
DRB:Data Request Broker MDIS:MetaData Information Server GridDaEnSI:Security Infrastructure GridEye:Monitor System GridDaEnSM: System Management
7School of Computer, National University of Defense Technology
Distributed Data Access and Management
Local MDIS
MDISMDIS
Data Center AData Center A Data Center BData Center B Data Center CData Center C
Client
Optimization and Scheduling
DRB DRB DRB
High-level MDIS
Local MDIS Local MDIS
Data ServiceData ServiceData ServiceData Service Data ServiceData Service
8School of Computer, National University of Defense Technology
Data ServiceDRB: Data Request Broker
Access dispatch System status and location of data
Data management Uniform view ： global logical view of data resources
Data replicating and moving
Data operation Posix like APIs: create, open, read, write, close, etc.
9School of Computer, National University of Defense Technology
Data ServiceFederated DRB Service
Distributed collaborated ser
vice Remote data access
Distributed data storage
Collaborate management
Distributed cache and replic
a Management of cache and cop
ies
On-demand storage and access
High performance data transp
ort
Cl i net(GUI )
DRBMaster
DRB Proxy
DRBserver
MDI S
DRBMaster
DRB Proxy
Remote DRBserver
Storagesystem
Storagesystem
MDI S
Storagesystem
Storagesystem
CenterMDI S
Cache Cache
Cache
accessbetween DEB
10School of Computer, National University of Defense Technology
Metadata Information Service
Global MDIS server System information Index information …
Local MDIS server Domain information File information …
GMDIS
Si te A
LDMISLMDIS
Si te B Si te C
11School of Computer, National University of Defense Technology
Metadata Information Service
Metadata access and management Uniform data namespace Data locating, registration, and publishing System information management Data discovery
Replication policy and management Nearest replica access Control of replica privileges Management of replica lifetime
12School of Computer, National University of Defense Technology
GridDaEn Security
GSI Compliance Only use Proxy function of GSI Separate GSI from Globus Toolkit
GridDaen Security Functionality ： Secure authentication Communication encryption Single sign on Role-based authentication management Multi-level user mapping
13School of Computer, National University of Defense Technology
GridEye: Monitor System
Based on GMA Producer/consumer mode
l Web Service Interface Multi-layer structure
Local monitor--LM Global monitor--GM
Global domain
GM manager
Local domain 1
…..
LM
Sensor1
up-level system
Local domain 1
…..
LM
Sensor1
Local domain 1
…..
LM
Sensor1
14School of Computer, National University of Defense Technology
GridDaEn Tools
User administrative clientUser data operation clientUIs supported:
Graphic user interface Command line APIs and SDKs
15School of Computer, National University of Defense Technology
GridDaEn v1.0 Features
Virtualized resources
Uniform operation and management
Coordination of autonomic system
High usability and security
Scalability
Multi-level authorization
Performance optimization
16School of Computer, National University of Defense Technology
Our Future Works
GridDaEn v1.0 Now available in our website www.griddaen.org www.datagrid.com.cn
GridDaEn v1.1 web service Based Available on 2005-1
GridDaEn v2.0 beta Structured data and semi- structured data supported
Related database ,XML database More native file system and access protocol supported Performance optimization Available on 2005-4