grid enabled pattern matching within the dame e-science pilot project 

17
Matching within the DAME e-Science Pilot Project Jim Austin Computer Science University of York

Upload: anila

Post on 22-Jan-2016

26 views

Category:

Documents


0 download

DESCRIPTION

Grid Enabled Pattern Matching within the DAME e-Science Pilot Project . Jim Austin Computer Science University of York. Rolls-Royce. University of Sheffield, P Fleming. University of Leeds, Peter Dew, Alison McKay. York, J Austin, J McDermid, A Wellings. - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Grid Enabled Pattern Matching within the DAME  e-Science Pilot Project 

Grid Enabled Pattern Matching within the DAME

e-Science Pilot Project 

Jim Austin

Computer Science

University of York

Page 2: Grid Enabled Pattern Matching within the DAME  e-Science Pilot Project 

All hands 2002 2

Rolls-Royce

University of Oxford, Lionel Tarassenko.

University of Leeds, Peter Dew, Alison McKay.

York, J Austin, J McDermid, A Wellings.

University of Sheffield, P Fleming.

Rolls-Royce, Derby.

Data Systems and Solutions.

Cybula Ltd.

Page 3: Grid Enabled Pattern Matching within the DAME  e-Science Pilot Project 

All hands 2002 3

Introduction• Objectives of DAME

• Diagnostics issues

• How AURA fits in

• AURA-G – GRID enabled AURA

• Where are we now?

Page 4: Grid Enabled Pattern Matching within the DAME  e-Science Pilot Project 

All hands 2002 4

DAME Objectives• DAME: Distributed Aircraft Maintenance

Environment.

• Demonstrate diagnostic capability on the GRID

• Examine timeliness properties of the GRID

• Demonstrate on the RR Aeroengine diagnostic problem

Page 5: Grid Enabled Pattern Matching within the DAME  e-Science Pilot Project 

All hands 2002 5

Engine flight data

Airline office

Maintenance Centre

European data center

London Airport

New York Airport

American data center

GridDiagnostics centre

Page 6: Grid Enabled Pattern Matching within the DAME  e-Science Pilot Project 

All hands 2002 6

Diagnostic issues• The system must analyse and report

– Novel engine operation– Identify any cause of events– Do this quickly

• Data– Large (many Tb)

Page 7: Grid Enabled Pattern Matching within the DAME  e-Science Pilot Project 

All hands 2002 7

Data – Zmod plots

Page 8: Grid Enabled Pattern Matching within the DAME  e-Science Pilot Project 

All hands 2002 8

Proposed pattern matchingprocess

QuoteNovelty indication

Data used to identify novelty

Data reductionprocesses

Features

Data stores/data warehouse

Diagnostic stationEngine data

Data to be searched for

Match requests

AURA-G

Diagnosis

Page 9: Grid Enabled Pattern Matching within the DAME  e-Science Pilot Project 

All hands 2002 9

How does AURA contribute• Search technology for multi-media data

• Parallel pattern match engine based on neural networks.

• Built on Correlation Matrix Memories.

• High performance Beowulf and dedicated hardware implementations.

• Commercially sold by Cybula Ltd.

Page 10: Grid Enabled Pattern Matching within the DAME  e-Science Pilot Project 

All hands 2002 10

AURA parallel implementation 28 dedicated PCI based processors

Beowulf configuration3.5Gb memory size

Cortex-1

Page 11: Grid Enabled Pattern Matching within the DAME  e-Science Pilot Project 

All hands 2002 11

Basic CMM

inputs

Samples of tracked orders

Page 12: Grid Enabled Pattern Matching within the DAME  e-Science Pilot Project 

All hands 2002 12

Data sample DM coding CMM

Matching previous events

Simple example of processing chain

Page 13: Grid Enabled Pattern Matching within the DAME  e-Science Pilot Project 

All hands 2002 13

Typical pre-processing

DM coding01101111011110111

(1 up 0 down)

FastPreserves informationProduces a binary vector

Time

Fre

quen

cy

Page 14: Grid Enabled Pattern Matching within the DAME  e-Science Pilot Project 

All hands 2002 14

QuoteNovelty indication

Data used to identify novelty

Data reductionprocesses

Features

Data stores/data warehouse

Diagnostic stationEngine data

Data to be searched for Pattern match

results

Match requests

AURA-G

GRID

Diagnosis

Page 15: Grid Enabled Pattern Matching within the DAME  e-Science Pilot Project 

All hands 2002 15

AURA-G

• This is a Globus enabled AURA implementation.

• Developed under DAME

• Will be available end of 2002 for use in other problems.

Page 16: Grid Enabled Pattern Matching within the DAME  e-Science Pilot Project 

All hands 2002 16

AURA-G

• Support of scalable pattern matching

• Supports distributed search, across multiple CMM engines at different sites

• OGSA compliant

Page 17: Grid Enabled Pattern Matching within the DAME  e-Science Pilot Project 

17 All hands 2002

Conclusions• AURA-G enabling fast access to large, complex

data.• Available for other applications• Diagnostic framework in DAME applicable

elsewhere.• DAME web site: www.cs.york.ac.uk/dame• AURA website:

– www.cs.york.ac.uk/arch/nn/aura.html– www.cybula.com