grid enabled pattern matching within the dame e-science pilot project jim austin computer science...

17
Matching within the DAME e-Science Pilot Project Jim Austin Computer Science University of York

Post on 19-Dec-2015

213 views

Category:

Documents


0 download

TRANSCRIPT

Grid Enabled Pattern Matching within the DAME

e-Science Pilot Project 

Jim Austin

Computer Science

University of York

All hands 2002 2

Rolls-Royce

University of Oxford, Lionel Tarassenko.

University of Leeds, Peter Dew, Alison McKay.

York, J Austin, J McDermid, A Wellings.

University of Sheffield, P Fleming.

Rolls-Royce, Derby.

Data Systems and Solutions.

Cybula Ltd.

All hands 2002 3

Introduction• Objectives of DAME

• Diagnostics issues

• How AURA fits in

• AURA-G – GRID enabled AURA

• Where are we now?

All hands 2002 4

DAME Objectives• DAME: Distributed Aircraft Maintenance

Environment.

• Demonstrate diagnostic capability on the GRID

• Examine timeliness properties of the GRID

• Demonstrate on the RR Aeroengine diagnostic problem

All hands 2002 5

Engine flight data

Airline office

Maintenance Centre

European data center

London Airport

New York Airport

American data center

GridDiagnostics centre

All hands 2002 6

Diagnostic issues• The system must analyse and report

– Novel engine operation– Identify any cause of events– Do this quickly

• Data– Large (many Tb)

All hands 2002 7

Data – Zmod plots

All hands 2002 8

Proposed pattern matchingprocess

QuoteNovelty indication

Data used to identify novelty

Data reductionprocesses

Features

Data stores/data warehouse

Diagnostic stationEngine data

Data to be searched for

Match requests

AURA-G

Diagnosis

All hands 2002 9

How does AURA contribute• Search technology for multi-media data

• Parallel pattern match engine based on neural networks.

• Built on Correlation Matrix Memories.

• High performance Beowulf and dedicated hardware implementations.

• Commercially sold by Cybula Ltd.

All hands 2002 10

AURA parallel implementation 28 dedicated PCI based processors

Beowulf configuration3.5Gb memory size

Cortex-1

All hands 2002 11

Basic CMM

inputs

Samples of tracked orders

All hands 2002 12

Data sample DM coding CMM

Matching previous events

Simple example of processing chain

All hands 2002 13

Typical pre-processing

DM coding01101111011110111

(1 up 0 down)

FastPreserves informationProduces a binary vector

Time

Fre

quen

cy

All hands 2002 14

QuoteNovelty indication

Data used to identify novelty

Data reductionprocesses

Features

Data stores/data warehouse

Diagnostic stationEngine data

Data to be searched for Pattern match

results

Match requests

AURA-G

GRID

Diagnosis

All hands 2002 15

AURA-G

• This is a Globus enabled AURA implementation.

• Developed under DAME

• Will be available end of 2002 for use in other problems.

All hands 2002 16

AURA-G

• Support of scalable pattern matching

• Supports distributed search, across multiple CMM engines at different sites

• OGSA compliant

17 All hands 2002

Conclusions• AURA-G enabling fast access to large, complex

data.• Available for other applications• Diagnostic framework in DAME applicable

elsewhere.• DAME web site: www.cs.york.ac.uk/dame• AURA website:

– www.cs.york.ac.uk/arch/nn/aura.html– www.cybula.com