attribute magic: restructure, validate, and other ways to control schema

24
Attribute Magic: Restructure, validate, and other ways to control schema

Upload: safe-software

Post on 22-Jan-2018

614 views

Category:

Technology


0 download

TRANSCRIPT

Attribute Magic:

Restructure, validate, and

other ways to control schema

FME 2016 gives you total control

over your data’s attributes.

Agenda

● Your attributes in FME

● Attribute management

– AttributeManager demo

● Quality control

– AttributeValidator demo

Your Attributes in FME

Attribute Management

Create, rename, copy,

delete, reorder, apply

expressions, and modify

all your attributes in a

single transformer.

It consolidates a lot of transformers.

What can it do?

➢ Create

➢ Rename

➢ Copy

➢ Remove

➢ Set values

➢ Reorder

➢ Concatenate (Text Editor)

➢ Apply arithmetic expressions (Arithmetic Editor)

➢ Set conditional values (Conditional Value)

➢ Reference earlier attributes

Automated Attribute Definitions

Tip: Choose Automatic mode on writer Feature Types.

Demo: Managing Attributes (CAD to GIS)

Did You Know?

86% of our GIS users

plan to use the

AttributeManager to

handle their

attributes.

Attribute Quality Control

Validate your attributes

against test conditions

and route them based

on pass / fail.

Challenge: Data Quality

If you distribute poor quality data you've amplified the problem.

If you distribute good quality data you've amplified the benefits.

Data validation is key to many FME workflows…

Challenge: Conforming to Standards

●ISO 19157 (GIS)

●NCS (CAD)

●OGC

●INSPIRE

●National, local,

your company, etc.

Challenge: Which tools to use?

➢ Tester and TestFilter

➢ AttributeCreator (conditional tests)

➢ AttributeClassifier

➢ AttributeRangeFilter & AttributeFilter

➢ NullAttributeMapper

➢ DuplicateRemover

➢ StringSearcher

➢ StatisticsCalculator

Solution: AttributeValidator

Be confident about the data you’re

loading into a destination dataset.

Simplify your workspaces.

What can it test?

➢ Type (integer, float, char, xml, json, etc.)

➢ ‘In’ (either a list or range). Good for domain validation

➢ Matches a regular expression

➢ Unique

➢ Not Null

➢ … and more …

Interpreting the Results

➢ Summary Attribute:

_fme_validation_message

➢ List of all messages:

_fme_validation_message_list{}

{0} Attribute 'CodePrefix' with value 'ABE' fails check for Matches Regular Expression '[ABCD]{3}'{1} Attribute 'num_measures' with value '12' fails check for in Range '[0,10]'{2} Attribute 'CodePrefix' with value 'ABE' fails check for in 'ABC,ABD,TXU,TXV'

Demo: Generating Validation Reports

● AttributeManager consolidates many attribute

transformers and adds new functionality.

● AttributeValidator helps you ensure your data is

good quality.

● Both of these simplify your workspaces by

reducing the number of transformers needed.

Learn More● http://fme.ly/attributes - Blog post on the

AttributeManager

● http://fme.ly/quality - Data quality

checklist

● FME Knowledge

Center

Thank you!

Questions?