User

Data Warehouse Warehouse

DBMS A DBMS B DBMS C

Database Database Database

Data warehouse example

User

DataMining Tools

Data WarehouseManager

Warehouse

DBMS A DBMS B DBMS C

Database Database Database

Data mining versus data warehousing

DataMiner

DataWarehouse

Database ManagementSystems

Warehouse Data

for Mining

Data for Warehousing

Database

Data

for Mining

Database systems, data warehousing, and mining

User

Warehouse Miner:Integrated Data Warehouse

and Data Miner

Warehouse

DBMS A DBMS B DBMS C

Database Database Database

Integrated data warehousing and data mining

User

DataMining Tools

Data WarehouseManager

Warehouse

DBMS A DBMS B DBMS C

Database Database Database

Data mining versus data warehousing

DataMiner

DataWarehouse

Database ManagementSystems

Warehouse DataFor Mining

Data forWarehousing

Database DataFor Mining

Database systems, data warehousing, and mining

User

Warehouse Miner,Integrated Data Warehouse

And Data MinerWarehouse

DBMS A DBMS B DBMS C

Database Database Database

Integrated data warehousing and data mining

StatisticalReasoning

DataWarehouse

Database ManagementSystems

Warehouse Data

For Mining

Data for

Warehousing

Database Data

For Mining

Statistical packages operating on databases

Data Mining Tool

Database Management System Database

Loose integration between a DBMS and a data miner

Database Management System+

Data Mining ToolDatabase

Tight integration between a DBMS and a data miner

Relation

Extractor

Object Database

Relational Database

Patterns Data Miner

Mining object databases

DataMiningTools

AuditDatabase

Mining an audit database

VisualizationTool

Database ManagementSystems

Data

To

Visualize

Request

Data

Database and visualization

Query Processor

MetadataManager

IntegrityManager

Transaction Processor

StorageManager

SecurityManager

Data Miner

Mining

DBMS

Functions of a mining DBMS

Query + Data Processor Miner

MetadataManager

StorageManager

IntegrityManager

SecurityManager

Mining

DBMS

Data mining as part of query processing

DataManagement

Warehousing

MachineLearning Mining

KnowledgeManagement

HumanComputerInteraction

Statistics

Decision support technologies

Decision SupportSystem Data

Miner

Data Warehouse

Database ManagementSystem

Results from Mining

Warehouse Data

For Mining

Data for

Warehousing

Database Data

For Mining

Decision support and multimedia data mining

Data Warehouse

Database ManagementSystems

Warehouse Data

For Mining

Data for

Warehousing

Database Data

For Mining

Machine learning and data mining

MachineLearning

Multimedia Communication, Network,Operating System

Multimedia Database System

Multimedia Data Warehouse

Multimedia Data Miner

DecisionSupport

Pyramid for multimedia mining

DatabaseSystem A

DatabaseSystem B

Middleware

MultimediaData Miner

Data Warehouse

Revisiting the data mining architecture

•Relational and Object Databases

•Multimedia Databases •Distributed, Heterogenous, and•Legacy Databases

•Security •Metadata •Visualization •Parallel Processing

•Warehouse•Machine Learning•Statistical Reasoning

Data

Support

Techniques

Three-dimensional view

Integration:

Middleware, Web

Client 1Client 2 Server

DatabaseSystem

Network

Server Warehouse

ServerData Miner

Client-server-based data mining

Client

Object

ServerDatabaseSystem

Object

Object Request Broker

ServerDataMiner

Object ServerDataWarehouse

Object

Data mining through an ORB

BookObject

Introduction

Set of Sections

References

Data model for text

QueryProcessor

Browser/Editor

Metadata Manager

UpdateProcessor

Security/IntegrityManager

Functional Architecture for a text processing system

Data MiningTool

Structured

Data

Unstructured Data

Converting unstructured data to structured data for mining

Determine DataSets Build Models

DevelopTrainingExamples

Classify NewData based onthe Models andExamples

Identify Patterns

Operation of data mining techniques

Data MiningTool

InformationRetrievalSystem

DataSource

Augmenting an information retrieval system

Data MiningTool

Unstructured

Data

Mining directly on unstructured data

TrueText Mining System

Extracting Structured Data fromText

Text Retrieval with SimpleMining

Intelligent Text Retrieval

Text Understanding System

Text Retrieval System

Taxonomy for text mining

ImageObject

Left Part ofImage

Center Part ofImage

Right Part ofImage

Data model for an image

QueryProcessor

Browser/Editor

Metadata Manager

UpdateProcessor

Security/IntegrityManager

Functional architecture for an image processing system

IMAGE MINING

Unusual Pattern

True Image Mining System

Extracting Structured Data from Images

Image Retrieval with Simple Mining

Intelligent Image Retrieval

Image Understanding System

Image Retrieval System

Taxonomy for image mining

VideoObject

AdvertisementsMain Film

FutureAttractions

Data model for video

QueryProcessor

Browser/Editor

Metadata Manager

UpdateProcessor

Security/IntegrityManager

Functional architecture for a video processing system

Video Frames

Summary Reports

Text Miner

PatternsandResults

Mining text extracted from video

Video Scripts/PatternsAs Metadata

Video Database Video InformationRetrieval

VideoMining

Patterns andTrends

Direct video mining

True Text Mining System

Extracting Structured Data from Text

Text Retrieval with SimpleMining

Intelligent Text RetrievalSchema

Text Understanding System

Text Retrieval System

Taxonomy for video mining

AudioObject

Speech

Applause

Questions

Data model for audio

QueryProcessor

Browser/Editor

Metadata Manager

UpdateProcessor

Security/IntegrityManager

Functional architecture for an audio processing system

Audio Frames

SpeechTranscription:Text Data

Text Miner

PatternsAndResults

Mining text extracted from audio

Audio Scripts/Patternsas Metadata

Audio MiningAudio/SpeechProcessing System

AudioDatabase

Patterns and Trends

Direct audio mining

True Audio Mining System

Extracting Structured Data from Audio

Audio Retrieval with Simple Mining

Intelligent Audio Retrieval

Audio Understanding System

Audio Retrieval System

Taxonomy for audio mining

Multimedia Data Miner

Integrated View of Multimedia Database

DMP DMP DMP

Text DBMS Video DBMS Audio DBMS

Text Database Video Database Audio Database

Integration and then mining

Integrating the Results

DMP DMP DMP

Text Miner Video Miner Audio Miner

Text DBMS Video DBMS Audio DBMS

Text Database Video Database Audio Database

Integrating the results of various data miners

Mining Tool C Mining Tool D

Internet AccessModule for C

Internet AccessModule for D

INTERNET

Internet AccessModule for A

Internet AccessModule for B

DBMSVendor A

DBMSVendor B

Database A Database B

Data mining through the Web

KnowledgeDiscovery

PatternDiscovery Knowledge

Mining

DataDredging

Data Mining

DataArcheology

The process of discovering meaningful new correlations,Patterns, and trends by sifting through large amounts ofstored data, using pattern recognition technologies and Statistical and mathematical techniques.

Different definitions of data mining

OutcomesOf Data Mining

Data MiningTechniques Approaches to

Data Mining

HowData Miningis carried out

Aspects of data mining

Security andPrivacy

MultimediaMining

DataMiningTrends

Web Mining MiningDistributed,

Heterogeneous, andLegacy Databases

MetadataMining

Data mining trends

QualityDatabase

Data MinerTo Improve

Quality

Database

Data MinerTo DetectPatterns

Patterns andTrends

Data quality and data mining

Data MiningTool

VisualizationTool

DBMS

Interactive data mining

DataMining

Algorithms

ParallelProcessingTechniques

ParallelizedData MiningAlgorithms

Parallel data mining

TrainingExamples

AnalyzingData

ProducingResults

Data mining functions

Thin Client

Middle Tier:Data Mining Components

Server DBMS

Three-tier architecture for data miner

Object

Data Miner Object

Object Request Broker

Results Pruner

Object ReportGenerator

Object

Encapsulating data mining modules as objects

Data SourceIntegrator

Medical:Diagnosis

InlandRevenueService:Analyze TaxReturns

Retail/Wholesale:Marketing And Sales

Data Mining

Financial:EconomicAnalysis

Intelligence:Foreign AffairsAnalysis

Education:StudentPromotion

Some data mining application areas

RelationalDatabases Files Multimedia

Databases

Paper

Humans WorldWideWeb

Data, data and more data

What we do with the data?

Mine, mine, and mine

Until we get useful information.

Why data mining?

IntegrateDataSources

Clean/ModifyData

Sources

MineThe Data

ExamineResults/PruneResults

ReportFinalResults

Data

Sources

Steps of mining data

Results fromData Miner

Knowledge-BasedSystem and/orHuman Analystfor PruningResults

Pruned Results

KnowledgeBase

Real-WorldKnowledge

Pruning the results

InadequateTools

Data MiningChallenges

Bad QualityData

Incomplete andIncorrect Data Inadequate

Training

Some data mining challenges

SQL QueryGenerator

ApplicationGenerator

ReportGenerator

SelectOutcomes

SelectApproaches

SelectTechniques

Example user interface for mining

Data Mining Tasks (Outcomes):Classification, Clustering,Association, Deviation Detection

Data Mining Techniques(Algorithms):Neural NetworksInductive Logic ProgrammingDecision Trees, Nearest Neighbour

Data Mining Methodologies(Approaches):Top-DownBottom-Up(Supervised or Unsupervised)Hybrid

Data mining tasks, techniques, and methodologies

DetermineInitial Set ofExpectedOutcomes

Carry OutData MiningTechniques

ExtractPatterns

DetermineNewOutcomesfrom thePatternsObserved

Data mining outcomes

Data MiningApproaches/Methodologies

Top-Down:Start with hypothesis and validate hypothesis,Hypothesis may be formed, initially from bottom-up approach or from some real-world knowledge,If hypothesis is not satisfied, then revise hypothesis

Bottom-up: Analyze the data and extract patterns,Directed/Supervised: You have some idea what you are lookingfor, Undirected/Unsupervised, You have no idea what you arelooking for

Some data mining approaches

StatisticsDecisionSupport

DatabaseManagementandWarehousing

DataMining

MachineLearning

VisualizationParallelProcessing

Data mining technologies