bid ce workshop 1 session 08 - biodiversity data cleaning

34
24 AUGUST 2016 THE BID PROGRAMME IS FUNDED BY THE EUROPEAN UNION Data Cleaning Nestor Beltran

Upload: alberto-gonzalez-talavan

Post on 19-Feb-2017

382 views

Category:

Education


0 download

TRANSCRIPT

Page 1: BID CE workshop 1   session 08 - Biodiversity Data Cleaning

24 AUGUST 2016THE BID PROGRAMME IS FUNDED BY THE EUROPEAN UNION

Data CleaningNestor Beltran

Page 2: BID CE workshop 1   session 08 - Biodiversity Data Cleaning

DATA CURATION, FORMATTING & TRANSFORMATION

Basic concepts of data cleaning

Page 3: BID CE workshop 1   session 08 - Biodiversity Data Cleaning

MANIPULATION, FORMATAGE ET TRANSFORMATION DE DONNÉES

Concepts de base sur le nettoyage des données

Page 4: BID CE workshop 1   session 08 - Biodiversity Data Cleaning

What is data cleaning?A process used to improve the

quality through correction of detected errors and omissions

• Define and determine error types

• Search and identify error instances

• Correct the errors

• Document error instances and error types

• Modify data entry procedures to reduce future errors

Page 5: BID CE workshop 1   session 08 - Biodiversity Data Cleaning

• Définir et déterminer les erreurs types

• Chercher et identifier les occurrences d’erreurs

• Corriger les erreurs

• Documenter les cas d’erreurs et d’erreurs types

• Modifier le procédé d’entrée de données afin de réduire les erreurs futures

Qu'est-ce que c'est le nettoyage de données ?Un procédé utilisé pour

améliorer la qualité en corrigeant les erreurs détectées et les oublis

Page 6: BID CE workshop 1   session 08 - Biodiversity Data Cleaning

The need for Data Cleaning

Is centred around improving the quality of data to make them

“fit for use”

Page 7: BID CE workshop 1   session 08 - Biodiversity Data Cleaning

La nécessité du Nettoyage des Données

Englobe l’amélioration de la qualité des données afin de les rendre

“adaptées à l’emploi”

Page 8: BID CE workshop 1   session 08 - Biodiversity Data Cleaning

DATA CURATION, FORMATTING & TRANSFORMATION

Principles of Data Cleaning

Page 9: BID CE workshop 1   session 08 - Biodiversity Data Cleaning

MANIPULATION, FORMATAGE ET TRANSFORMATION DE DONNÉES

Principes du Nettoyage des Données

Page 10: BID CE workshop 1   session 08 - Biodiversity Data Cleaning

Principles

●Planning

Page 11: BID CE workshop 1   session 08 - Biodiversity Data Cleaning

Principes

●Préparation

Page 12: BID CE workshop 1   session 08 - Biodiversity Data Cleaning

Principles

●Planning●Organizing

Page 13: BID CE workshop 1   session 08 - Biodiversity Data Cleaning

Principes

●Préparation●Organisation

Page 14: BID CE workshop 1   session 08 - Biodiversity Data Cleaning

Principles

●Planning●Organizing●Prevention

Page 15: BID CE workshop 1   session 08 - Biodiversity Data Cleaning

Principes

●Préparation●Organisation●Prévention

Page 16: BID CE workshop 1   session 08 - Biodiversity Data Cleaning

Principles

●Planning●Organizing●Prevention●Responsibility

Page 17: BID CE workshop 1   session 08 - Biodiversity Data Cleaning

Principes

●Préparation●Organisation●Prévention●Responsabilité

Page 18: BID CE workshop 1   session 08 - Biodiversity Data Cleaning

Principles

●Planning●Organizing●Prevention●Responsibility●Partnership

Page 19: BID CE workshop 1   session 08 - Biodiversity Data Cleaning

Principes

●Préparation●Organisation●Prévention●Responsabilité●Partenariat

Page 20: BID CE workshop 1   session 08 - Biodiversity Data Cleaning

Principles

●Planning●Organizing●Prevention●Responsibility●Partnership●Prioritisation

Page 21: BID CE workshop 1   session 08 - Biodiversity Data Cleaning

Principes

●Préparation●Organisation●Prévention●Responsabilité●Partenariat●Priorétiser

Page 22: BID CE workshop 1   session 08 - Biodiversity Data Cleaning

Principles

●Planning●Organizing●Prevention●Responsibility●Partnership●Prioritisation●Performance measures

Page 23: BID CE workshop 1   session 08 - Biodiversity Data Cleaning

Principes

●Préparation●Organisation●Prévention●Responsabilité●Partenariat●Priorétiser●Mesures de

Performance

Page 24: BID CE workshop 1   session 08 - Biodiversity Data Cleaning

Principles

●Planning●Organizing●Prevention●Responsibility●Partnership●Prioritisation●Performance measures●Optimization●Feedback●Training●Transparency●Documentation

Page 25: BID CE workshop 1   session 08 - Biodiversity Data Cleaning

Principes

●Préparation●Organisation●Prévention●Responsabilité●Partenariat●Priorétiser●Mesures de

Performance●Optimisation●Feedback●Formation●Transparence●Documentation

Page 26: BID CE workshop 1   session 08 - Biodiversity Data Cleaning

Principles

●Planning●Organizing●Prevention●Responsibility●Partnership●Prioritisation●Performance measures●Optimization●Feedback●Training●Transparency●Documentation

Page 27: BID CE workshop 1   session 08 - Biodiversity Data Cleaning

Principes

●Préparation●Organisation●Prévention●Responsabilité●Partenariat●Priorétiser●Mesures de

Performance●Optimisation●Feedback●Formation●Transparence●Documentation

Page 28: BID CE workshop 1   session 08 - Biodiversity Data Cleaning

Principles

●Planning●Organizing●Prevention●Responsibility●Partnership●Prioritisation●Performance measures●Optimization●Feedback●Training●Transparency●Documentation

Page 29: BID CE workshop 1   session 08 - Biodiversity Data Cleaning

Principes

●Préparation●Organisation●Prévention●Responsabilité●Partenariat●Priorétiser●Mesures de

Performance●Optimisation●Feedback●Formation●Transparence●Documentation

Page 30: BID CE workshop 1   session 08 - Biodiversity Data Cleaning

Principles

●Planning●Organizing●Prevention●Responsibility●Partnership●Prioritisation●Performance measures●Optimization●Feedback●Training●Transparency●Documentation

Page 31: BID CE workshop 1   session 08 - Biodiversity Data Cleaning

Principes

●Préparation●Organisation●Prévention●Responsabilité●Partenariat●Priorétiser●Mesures de

Performance●Optimisation●Feedback●Formation●Transparence●Documentation

Page 32: BID CE workshop 1   session 08 - Biodiversity Data Cleaning

Principles

●Planning●Organizing●Prevention●Responsibility●Partnership●Prioritisation●Performance measures●Optimization●Feedback●Training●Transparency●Documentation

Page 33: BID CE workshop 1   session 08 - Biodiversity Data Cleaning

Principes

●Préparation●Organisation●Prévention●Responsabilité●Partenariat●Priorétiser●Mesures de

Performance●Optimisation●Feedback●Formation●Transparence●Documentation

Page 34: BID CE workshop 1   session 08 - Biodiversity Data Cleaning

24 AUGUST 2016THE BID PROGRAMME IS FUNDED BY THE EUROPEAN UNION

Data CleaningNéstor Beltrán