attribute magic: restructure, validate, and other ways to control schema
TRANSCRIPT
Agenda
● Your attributes in FME
● Attribute management
– AttributeManager demo
● Quality control
– AttributeValidator demo
Create, rename, copy,
delete, reorder, apply
expressions, and modify
all your attributes in a
single transformer.
What can it do?
➢ Create
➢ Rename
➢ Copy
➢ Remove
➢ Set values
➢ Reorder
➢ Concatenate (Text Editor)
➢ Apply arithmetic expressions (Arithmetic Editor)
➢ Set conditional values (Conditional Value)
➢ Reference earlier attributes
Demo: Managing Attributes (CAD to GIS)
Did You Know?
86% of our GIS users
plan to use the
AttributeManager to
handle their
attributes.
Challenge: Data Quality
If you distribute poor quality data you've amplified the problem.
If you distribute good quality data you've amplified the benefits.
Data validation is key to many FME workflows…
Challenge: Conforming to Standards
●ISO 19157 (GIS)
●NCS (CAD)
●OGC
●INSPIRE
●National, local,
your company, etc.
Challenge: Which tools to use?
➢ Tester and TestFilter
➢ AttributeCreator (conditional tests)
➢ AttributeClassifier
➢ AttributeRangeFilter & AttributeFilter
➢ NullAttributeMapper
➢ DuplicateRemover
➢ StringSearcher
➢ StatisticsCalculator
Solution: AttributeValidator
Be confident about the data you’re
loading into a destination dataset.
Simplify your workspaces.
What can it test?
➢ Type (integer, float, char, xml, json, etc.)
➢ ‘In’ (either a list or range). Good for domain validation
➢ Matches a regular expression
➢ Unique
➢ Not Null
➢ … and more …
Interpreting the Results
➢ Summary Attribute:
_fme_validation_message
➢ List of all messages:
_fme_validation_message_list{}
{0} Attribute 'CodePrefix' with value 'ABE' fails check for Matches Regular Expression '[ABCD]{3}'{1} Attribute 'num_measures' with value '12' fails check for in Range '[0,10]'{2} Attribute 'CodePrefix' with value 'ABE' fails check for in 'ABC,ABD,TXU,TXV'
● AttributeManager consolidates many attribute
transformers and adds new functionality.
● AttributeValidator helps you ensure your data is
good quality.
● Both of these simplify your workspaces by
reducing the number of transformers needed.
Learn More● http://fme.ly/attributes - Blog post on the
AttributeManager
● http://fme.ly/quality - Data quality
checklist
● FME Knowledge
Center