cs157a lecture 2 db mangement systems prof. sin-min lee department of computer science san jose...

36
CS157A Lecture 2 CS157A Lecture 2 DB Mangement Systems DB Mangement Systems Prof. Sin-Min Lee Department of Computer Science San Jose State University

Post on 19-Dec-2015

215 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: CS157A Lecture 2 DB Mangement Systems Prof. Sin-Min Lee Department of Computer Science San Jose State University

CS157A Lecture 2 CS157A Lecture 2 DB Mangement SystemsDB Mangement Systems

Prof. Sin-Min Lee

Department of Computer Science

San Jose State University

Page 2: CS157A Lecture 2 DB Mangement Systems Prof. Sin-Min Lee Department of Computer Science San Jose State University

©Silberschatz, Korth and Sudarshan1.2Database System Concepts

Chapter 1: IntroductionChapter 1: Introduction

Purpose of Database Systems

View of Data

Data Models

Data Definition Language

Data Manipulation Language

Transaction Management

Storage Management

Database Administrator

Database Users

Overall System Structure

Page 3: CS157A Lecture 2 DB Mangement Systems Prof. Sin-Min Lee Department of Computer Science San Jose State University

©Silberschatz, Korth and Sudarshan1.3Database System Concepts

1. 1. Database TheoryDatabase Theory

Why use database?

Data is a valuable corporate resource which needs adequate, accuracy, consistency and security controls.

The centralised control of data means that for many applications the data will already exist, and facilitate quicker development.

Data will no longer be related by application programs, but by the structure defined in the database.

Easier to maintain systems

Page 4: CS157A Lecture 2 DB Mangement Systems Prof. Sin-Min Lee Department of Computer Science San Jose State University

©Silberschatz, Korth and Sudarshan1.4Database System Concepts

In the the past as new applications were written they used existing files, or created a new file for their use.

Sometimes several existing files need to be sorted and merged to obtain the new file.Thus, it is probable that several files will contain the same information stored in different ways. In other words, there will be redundant and possibly inconsistent data.

Consider the files for an insurance company

Traditional File Systems

POLICY#

POLICYHOLDER

PREMIUMS data ADDRESS

PREMIUM-PA

PREMIUM-TOTAL

POLICY#

POLICYHOLDER

AGENCY data ADDRESS

AGENT-CODE

RENEWAL-DATE

RENEWAL-AMT

Page 5: CS157A Lecture 2 DB Mangement Systems Prof. Sin-Min Lee Department of Computer Science San Jose State University

©Silberschatz, Korth and Sudarshan1.5Database System Concepts

Applications were often considered in relative isolation.

Data that should have been together was not.

The potential for flexible enquiry and reporting was limited.

All validations were in the programs.

Procedures were required to for backup and recovery.

All programmers had access to all records.

There was limited concurrent access.

Traditional File Systems

Page 6: CS157A Lecture 2 DB Mangement Systems Prof. Sin-Min Lee Department of Computer Science San Jose State University

©Silberschatz, Korth and Sudarshan1.6Database System Concepts

Basic Definitions

Database: A collection of related data

Data: Known facts that can be recorded

Schema: Some part of the real world about which data is stored in the database.

Database Management System(DBMS):A software package to facilitate the creation and maintenance of a computerised database.

Page 7: CS157A Lecture 2 DB Mangement Systems Prof. Sin-Min Lee Department of Computer Science San Jose State University

©Silberschatz, Korth and Sudarshan1.7Database System Concepts

Degrees of Data IndependenceDegrees of Data Independence· Device Characteristics

· Blocking Factors

· Data Access Organisation

· Physical Record Location

· Logical Views (Local)

· Virtual Data Items

· Virtual Records

· Data Value Characteristics

· Data Element Name Only

Page 8: CS157A Lecture 2 DB Mangement Systems Prof. Sin-Min Lee Department of Computer Science San Jose State University

©Silberschatz, Korth and Sudarshan1.8Database System Concepts

Logical vs Physical Data IndependenceLogical vs Physical Data Independence

GLOBALLOGICAL

DATABASEDESCRIPTION

Application

Program

Local Views

Physical

Files

Logical Data

Independence

Physical Data

Independence

Page 9: CS157A Lecture 2 DB Mangement Systems Prof. Sin-Min Lee Department of Computer Science San Jose State University

©Silberschatz, Korth and Sudarshan1.9Database System Concepts

Three Schema ArchitectureThree Schema Architecture

ANSI & ISO suggest that DBMS should have three schemas

· CONCEPTUAL SCHEMA - the global logical model of the data and processing of the enterprise. i.e community user view.

· EXTERNAL SCHEMA(S) - the logical application views of the CS. i.e individual user views.

· INTERNAL SCHEMA - internal level storage view.

Page 10: CS157A Lecture 2 DB Mangement Systems Prof. Sin-Min Lee Department of Computer Science San Jose State University

©Silberschatz, Korth and Sudarshan1.10Database System Concepts

External Schema 1

External Schema 2

External Schema n

ConceptualSchema

InternalSchema

Three Schema ArchitectureThree Schema Architecture

Page 11: CS157A Lecture 2 DB Mangement Systems Prof. Sin-Min Lee Department of Computer Science San Jose State University

©Silberschatz, Korth and Sudarshan1.11Database System Concepts

The External LevelThe External Level

· Each user has a language through which they access or see the database.

· For the programmer - COBOL etc, for the end-user a query language or special purpose language.

· All languages will contain a data sub-language which may be tightly or loosely coupled to the host language.

Page 12: CS157A Lecture 2 DB Mangement Systems Prof. Sin-Min Lee Department of Computer Science San Jose State University

©Silberschatz, Korth and Sudarshan1.12Database System Concepts

· DSLs generally contain a data definition language DDL and data manipulation language DML.

Page 13: CS157A Lecture 2 DB Mangement Systems Prof. Sin-Min Lee Department of Computer Science San Jose State University

©Silberschatz, Korth and Sudarshan1.13Database System Concepts

The Conceptual LevelThe Conceptual Level

· A representation of the entire information content of the database.

· Defined with a Conceptual Schema Language which does not represent any storage or access details.

· Should include all security and integrity rules and some suggest the CS should describe the total enterprise including all allowable processing.

Page 14: CS157A Lecture 2 DB Mangement Systems Prof. Sin-Min Lee Department of Computer Science San Jose State University

©Silberschatz, Korth and Sudarshan1.14Database System Concepts

The Internal LevelThe Internal Level

· Low level representation of entire database.

· Deals with stored records rather than conceptual or external records.

· Stored records may differ in structure from conceptual records and external records.

· The Internal Schema is still one level away from physical records which are often called pages or blocks

Page 15: CS157A Lecture 2 DB Mangement Systems Prof. Sin-Min Lee Department of Computer Science San Jose State University

©Silberschatz, Korth and Sudarshan1.15Database System Concepts

Inter-Related DataInter-Related Data

CLAIMS

RENEWALS

AGENCY

DBMS

RENEWALS

CLAIMS AGENCY

QUERY

Data related by structure

Flexible enquiry easier

Page 16: CS157A Lecture 2 DB Mangement Systems Prof. Sin-Min Lee Department of Computer Science San Jose State University

©Silberschatz, Korth and Sudarshan1.16Database System Concepts

Multiple Applications

CLAIMSAGENCY

DATABASELOCALVIEWS

RENEWALS

Page 17: CS157A Lecture 2 DB Mangement Systems Prof. Sin-Min Lee Department of Computer Science San Jose State University

©Silberschatz, Korth and Sudarshan1.17Database System Concepts

Database Management System (DBMS)Database Management System (DBMS)

Collection of interrelated data Set of programs to access the data DBMS contains information about a particular enterprise DBMS provides an environment that is both convenient and

efficient to use. Database Applications:

Banking: all transactions Airlines: reservations, schedules Universities: registration, grades Sales: customers, products, purchases Manufacturing: production, inventory, orders, supply chain Human resources: employee records, salaries, tax deductions

Databases touch all aspects of our lives

Page 18: CS157A Lecture 2 DB Mangement Systems Prof. Sin-Min Lee Department of Computer Science San Jose State University

©Silberschatz, Korth and Sudarshan1.18Database System Concepts

Purpose of Database SystemPurpose of Database System

In the early days, database applications were built on top of file systems

Drawbacks of using file systems to store data: Data redundancy and inconsistency

Multiple file formats, duplication of information in different files

Difficulty in accessing data

Need to write a new program to carry out each new task

Data isolation — multiple files and formats

Integrity problems

Integrity constraints (e.g. account balance > 0) become part of program code

Hard to add new constraints or change existing ones

Page 19: CS157A Lecture 2 DB Mangement Systems Prof. Sin-Min Lee Department of Computer Science San Jose State University

©Silberschatz, Korth and Sudarshan1.19Database System Concepts

Purpose of Database Systems (Cont.)Purpose of Database Systems (Cont.)

Drawbacks of using file systems (cont.) Atomicity of updates

Failures may leave database in an inconsistent state with partial updates carried out

E.g. transfer of funds from one account to another should either complete or not happen at all

Concurrent access by multiple users

Concurrent accessed needed for performance

Uncontrolled concurrent accesses can lead to inconsistencies

– E.g. two people reading a balance and updating it at the same time

Security problems

Database systems offer solutions to all the above problems

Page 20: CS157A Lecture 2 DB Mangement Systems Prof. Sin-Min Lee Department of Computer Science San Jose State University

©Silberschatz, Korth and Sudarshan1.20Database System Concepts

Levels of AbstractionLevels of Abstraction

Physical level describes how a record (e.g., customer) is stored.

Logical level: describes data stored in database, and the relationships among the data.

type customer = recordname : string;street : string;city : integer;

end;

View level: application programs hide details of data types. Views can also hide information (e.g., salary) for security purposes.

Page 21: CS157A Lecture 2 DB Mangement Systems Prof. Sin-Min Lee Department of Computer Science San Jose State University

©Silberschatz, Korth and Sudarshan1.21Database System Concepts

View of DataView of Data

An architecture for a database system

Page 22: CS157A Lecture 2 DB Mangement Systems Prof. Sin-Min Lee Department of Computer Science San Jose State University

©Silberschatz, Korth and Sudarshan1.22Database System Concepts

Instances and SchemasInstances and Schemas

Similar to types and variables in programming languages

Schema – the logical structure of the database e.g., the database consists of information about a set of customers and

accounts and the relationship between them)

Analogous to type information of a variable in a program

Physical schema: database design at the physical level

Logical schema: database design at the logical level

Instance – the actual content of the database at a particular point in time Analogous to the value of a variable

Physical Data Independence – the ability to modify the physical schema without changing the logical schema Applications depend on the logical schema

In general, the interfaces between the various levels and components should be well defined so that changes in some parts do not seriously influence others.

Page 23: CS157A Lecture 2 DB Mangement Systems Prof. Sin-Min Lee Department of Computer Science San Jose State University

©Silberschatz, Korth and Sudarshan1.23Database System Concepts

Data ModelsData Models

A collection of tools for describing data data relationships data semantics data constraints

Entity-Relationship model

Relational model

Other models: object-oriented model semi-structured data models Older models: network model and hierarchical model

Page 24: CS157A Lecture 2 DB Mangement Systems Prof. Sin-Min Lee Department of Computer Science San Jose State University

©Silberschatz, Korth and Sudarshan1.24Database System Concepts

Entity-Relationship ModelEntity-Relationship Model

Example of schema in the entity-relationship model

Page 25: CS157A Lecture 2 DB Mangement Systems Prof. Sin-Min Lee Department of Computer Science San Jose State University

©Silberschatz, Korth and Sudarshan1.25Database System Concepts

Entity Relationship Model (Cont.)Entity Relationship Model (Cont.)

E-R model of real world Entities (objects)

E.g. customers, accounts, bank branch

Relationships between entities

E.g. Account A-101 is held by customer Johnson

Relationship set depositor associates customers with accounts

Widely used for database design Database design in E-R model usually converted to design in the

relational model (coming up next) which is used for storage and processing

Page 26: CS157A Lecture 2 DB Mangement Systems Prof. Sin-Min Lee Department of Computer Science San Jose State University

©Silberschatz, Korth and Sudarshan1.26Database System Concepts

Relational ModelRelational Model

Example of tabular data in the relational model

customer-name

Customer-idcustomer-street

customer-city

account-number

Johnson

Smith

Johnson

Jones

Smith

192-83-7465

019-28-3746

192-83-7465

321-12-3123

019-28-3746

Alma

North

Alma

Main

North

Palo Alto

Rye

Palo Alto

Harrison

Rye

A-101

A-215

A-201

A-217

A-201

Attributes

Page 27: CS157A Lecture 2 DB Mangement Systems Prof. Sin-Min Lee Department of Computer Science San Jose State University

©Silberschatz, Korth and Sudarshan1.27Database System Concepts

A Sample Relational DatabaseA Sample Relational Database

Page 28: CS157A Lecture 2 DB Mangement Systems Prof. Sin-Min Lee Department of Computer Science San Jose State University

©Silberschatz, Korth and Sudarshan1.28Database System Concepts

Data Definition Language (DDL)Data Definition Language (DDL)

Specification notation for defining the database schema E.g.

create table account ( account-number char(10), balance integer)

DDL compiler generates a set of tables stored in a data dictionary

Data dictionary contains metadata (i.e., data about data) database schema

Data storage and definition language

language in which the storage structure and access methods used by the database system are specified

Usually an extension of the data definition language

Page 29: CS157A Lecture 2 DB Mangement Systems Prof. Sin-Min Lee Department of Computer Science San Jose State University

©Silberschatz, Korth and Sudarshan1.29Database System Concepts

Data Manipulation Language (DML)Data Manipulation Language (DML)

Language for accessing and manipulating the data organized by the appropriate data model DML also known as query language

Two classes of languages Procedural – user specifies what data is required and how to get

those data

Nonprocedural – user specifies what data is required without specifying how to get those data

SQL is the most widely used query language

Page 30: CS157A Lecture 2 DB Mangement Systems Prof. Sin-Min Lee Department of Computer Science San Jose State University

©Silberschatz, Korth and Sudarshan1.30Database System Concepts

SQLSQL

SQL: widely used non-procedural language E.g. find the name of the customer with customer-id 192-83-7465

select customer.customer-namefrom customerwhere customer.customer-id = ‘192-83-7465’

E.g. find the balances of all accounts held by the customer with customer-id 192-83-7465

select account.balancefrom depositor, accountwhere depositor.customer-id = ‘192-83-7465’ and depositor.account-number = account.account-

number

Application programs generally access databases through one of Language extensions to allow embedded SQL

Application program interface (e.g. ODBC/JDBC) which allow SQL queries to be sent to a database

Page 31: CS157A Lecture 2 DB Mangement Systems Prof. Sin-Min Lee Department of Computer Science San Jose State University

©Silberschatz, Korth and Sudarshan1.31Database System Concepts

Database UsersDatabase Users

Users are differentiated by the way they expect to interact with the system

Application programmers – interact with system through DML calls

Sophisticated users – form requests in a database query language

Specialized users – write specialized database applications that do not fit into the traditional data processing framework

Naïve users – invoke one of the permanent application programs that have been written previously E.g. people accessing database over the web, bank tellers, clerical

staff

Page 32: CS157A Lecture 2 DB Mangement Systems Prof. Sin-Min Lee Department of Computer Science San Jose State University

©Silberschatz, Korth and Sudarshan1.32Database System Concepts

Database AdministratorDatabase Administrator

Coordinates all the activities of the database system; the database administrator has a good understanding of the enterprise’s information resources and needs.

Database administrator's duties include: Schema definition

Storage structure and access method definition

Schema and physical organization modification

Granting user authority to access the database

Specifying integrity constraints

Acting as liaison with users

Monitoring performance and responding to changes in requirements

Page 33: CS157A Lecture 2 DB Mangement Systems Prof. Sin-Min Lee Department of Computer Science San Jose State University

©Silberschatz, Korth and Sudarshan1.33Database System Concepts

Transaction ManagementTransaction Management

A transaction is a collection of operations that performs a single logical function in a database application

Transaction-management component ensures that the database remains in a consistent (correct) state despite system failures (e.g., power failures and operating system crashes) and transaction failures.

Concurrency-control manager controls the interaction among the concurrent transactions, to ensure the consistency of the database.

Page 34: CS157A Lecture 2 DB Mangement Systems Prof. Sin-Min Lee Department of Computer Science San Jose State University

©Silberschatz, Korth and Sudarshan1.34Database System Concepts

Storage ManagementStorage Management

Storage manager is a program module that provides the interface between the low-level data stored in the database and the application programs and queries submitted to the system.

The storage manager is responsible to the following tasks: interaction with the file manager

efficient storing, retrieving and updating of data

Page 35: CS157A Lecture 2 DB Mangement Systems Prof. Sin-Min Lee Department of Computer Science San Jose State University

©Silberschatz, Korth and Sudarshan1.35Database System Concepts

Overall System Structure Overall System Structure

Page 36: CS157A Lecture 2 DB Mangement Systems Prof. Sin-Min Lee Department of Computer Science San Jose State University

©Silberschatz, Korth and Sudarshan1.36Database System Concepts

Application ArchitecturesApplication Architectures

Two-tier architecture: E.g. client programs using ODBC/JDBC to communicate with a databaseThree-tier architecture: E.g. web-based applications, and applications built using “middleware”