evangelium nicodemi (a database application) data application demonstration next steps ... 1...
TRANSCRIPT
![Page 1: Evangelium Nicodemi (a database application) Data Application Demonstration Next Steps ... 1 Ron.pdf · 2017-06-22 · Data Application Demonstration Next Steps Ron McFadyen University](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed395187ec1ed47a70d6644/html5/thumbnails/1.jpg)
1 / 26
Data
Application
Demonstration
Next Steps
Ron McFadyen
University of Winnipeg, Canada
Evangelium Nicodemi
(a database application)
![Page 2: Evangelium Nicodemi (a database application) Data Application Demonstration Next Steps ... 1 Ron.pdf · 2017-06-22 · Data Application Demonstration Next Steps Ron McFadyen University](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed395187ec1ed47a70d6644/html5/thumbnails/2.jpg)
2 / 26
Data
Evangelium Nicodemi
(a database application)
![Page 3: Evangelium Nicodemi (a database application) Data Application Demonstration Next Steps ... 1 Ron.pdf · 2017-06-22 · Data Application Demonstration Next Steps Ron McFadyen University](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed395187ec1ed47a70d6644/html5/thumbnails/3.jpg)
Source
Page 12:
3 / 26
![Page 4: Evangelium Nicodemi (a database application) Data Application Demonstration Next Steps ... 1 Ron.pdf · 2017-06-22 · Data Application Demonstration Next Steps Ron McFadyen University](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed395187ec1ed47a70d6644/html5/thumbnails/4.jpg)
4 / 26
Pages 5-8 explain structure of the data
Location: City Country Library
5 types of information: Location Shelf-mark Codicological info Incipits & explicits Sources
![Page 5: Evangelium Nicodemi (a database application) Data Application Demonstration Next Steps ... 1 Ron.pdf · 2017-06-22 · Data Application Demonstration Next Steps Ron McFadyen University](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed395187ec1ed47a70d6644/html5/thumbnails/5.jpg)
5 / 26
Pages 5-8 explain structure of the data
Origin Scribes Owners Contents Uses Incipits/Explicits
![Page 6: Evangelium Nicodemi (a database application) Data Application Demonstration Next Steps ... 1 Ron.pdf · 2017-06-22 · Data Application Demonstration Next Steps Ron McFadyen University](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed395187ec1ed47a70d6644/html5/thumbnails/6.jpg)
6 / 26
Consider entry # 1 on page 12
![Page 7: Evangelium Nicodemi (a database application) Data Application Demonstration Next Steps ... 1 Ron.pdf · 2017-06-22 · Data Application Demonstration Next Steps Ron McFadyen University](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed395187ec1ed47a70d6644/html5/thumbnails/7.jpg)
7 / 26
Consider entry # 1 on page 12
Siglum City Country Repository
Century
Shelf mark
There are pieces of information
![Page 8: Evangelium Nicodemi (a database application) Data Application Demonstration Next Steps ... 1 Ron.pdf · 2017-06-22 · Data Application Demonstration Next Steps Ron McFadyen University](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed395187ec1ed47a70d6644/html5/thumbnails/8.jpg)
8 / 26
Well-structured documents
Each entry can be represented using key/value pairs.
For example Entry #1:
Siglum = 1
City = Aachen
Country = Germany
Century = 15
...
![Page 9: Evangelium Nicodemi (a database application) Data Application Demonstration Next Steps ... 1 Ron.pdf · 2017-06-22 · Data Application Demonstration Next Steps Ron McFadyen University](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed395187ec1ed47a70d6644/html5/thumbnails/9.jpg)
9 / 26
Can be stored in a database in a number of ways
The approach we are using is JSON
JavaScript Object Notation
Example: presentation information for Réunion Annuelle 2017
Consider first presentation
20 h. 30 Isabel IRIBARREN (Université de Strasbourg), Utilisations et fonctions des écrits apocryphes dans l’œuvre de Jean Gerson.
Well-structured documents
![Page 10: Evangelium Nicodemi (a database application) Data Application Demonstration Next Steps ... 1 Ron.pdf · 2017-06-22 · Data Application Demonstration Next Steps Ron McFadyen University](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed395187ec1ed47a70d6644/html5/thumbnails/10.jpg)
Example of data expressed in JSON
20 h. 30 Isabel IRIBARREN (Université de Strasbourg), Utilisations et fonctions des écrits apocryphes dans l’œuvre de Jean Gerson.
In JSON
{
Time: { Hour: 20
Min: 30
}
Name: { First: Isabel
Last: IRIBARREN
} University: "Université de Strasbourg",
Title: "Utilisations et fonctions des
écrits apocryphes dans l’œuvre
de Jean Gerson."
}
10 / 26
![Page 11: Evangelium Nicodemi (a database application) Data Application Demonstration Next Steps ... 1 Ron.pdf · 2017-06-22 · Data Application Demonstration Next Steps Ron McFadyen University](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed395187ec1ed47a70d6644/html5/thumbnails/11.jpg)
11 / 26
JSON, JavaScript Object Notation
Self-describing
A syntax for storing and exchanging data
Human readable
![Page 12: Evangelium Nicodemi (a database application) Data Application Demonstration Next Steps ... 1 Ron.pdf · 2017-06-22 · Data Application Demonstration Next Steps Ron McFadyen University](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed395187ec1ed47a70d6644/html5/thumbnails/12.jpg)
12 / 26
Databases
Two broad categories
Relational
Since the 1970s
IBM, Oracle, Microsoft, PostGreSQL…
The standard for decades
Standard database query language: SQL
Requires a solid database schema definition
NoSQL – non relational
key-value, column family, document and graph stores
MongoDB, CouchDb, Cassandra, PostGreSQL …
Strong roots in open source
Do not need a rigorous database definition
![Page 13: Evangelium Nicodemi (a database application) Data Application Demonstration Next Steps ... 1 Ron.pdf · 2017-06-22 · Data Application Demonstration Next Steps Ron McFadyen University](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed395187ec1ed47a70d6644/html5/thumbnails/13.jpg)
13 / 26
MongoDB
The choice for our project
Popular + experience in our department
A so-called document database
Easily insert documents, in JSON format, into the database
Each entry in Census of Manuscripts is a document
436 documents organized in a MongoDB collection
Database comprises many collections
Each collection has many documents
![Page 14: Evangelium Nicodemi (a database application) Data Application Demonstration Next Steps ... 1 Ron.pdf · 2017-06-22 · Data Application Demonstration Next Steps Ron McFadyen University](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed395187ec1ed47a70d6644/html5/thumbnails/14.jpg)
14 / 26
JavaScript used to parse/translate an MS Word
copy of the text into JSON notation
1. AACHEN, Germany. Stadtarchiv
MS KK Regulierherren Nr. 9 (for...
160 ff. 210 x 280 mm.
Saec. XV.
Contents ...
*I/E Title 80ra Incipiunt gesta domini ...
SS Corresp. Dr. Thomas Kraus.
2. ALBA IULIA, Rumania. Biblioteca
Batthyaneum
MS R I 57
Paper. 202 ff. 295 x 210 mm.
Saec. XV in. (ca. 1407).
Scr. Five scribes…
...
SS Bibl. †Sopko, 1982, pp. 158-9.
Corresp. Dr. Iacob Mârza
3. ALBA IULIA, Rumania. Biblioteca Batthyaneum
MS R II 66
Paper. 297 ff. 305 x 220 mm.
Saec. XV/1.
Scr. Six scribes
…
SS Bibl. †Sopko, 1982, pp. 220-2.
Corresp. Dr. Iacob Mârza.
{
Siglum: 1,
City: "Aachen",
Country: "Germany",
Repository:"Stadtarchiv",
...
{
Siglum: 2,
City: "Alba Iulia",
Country: "Rumania",
Repository:"Biblioteca
Batthyaneum",
...
{
Siglum: 1,
City: "Alba Iulia",
Country: "Rumania",
Repository:"Biblioteca
Batthyaneum",
...
S O U R C E
D A T A B A S E
![Page 15: Evangelium Nicodemi (a database application) Data Application Demonstration Next Steps ... 1 Ron.pdf · 2017-06-22 · Data Application Demonstration Next Steps Ron McFadyen University](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed395187ec1ed47a70d6644/html5/thumbnails/15.jpg)
15 / 26
Evangelium Nicodemi,
a database application
Application
![Page 16: Evangelium Nicodemi (a database application) Data Application Demonstration Next Steps ... 1 Ron.pdf · 2017-06-22 · Data Application Demonstration Next Steps Ron McFadyen University](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed395187ec1ed47a70d6644/html5/thumbnails/16.jpg)
16 / 26
Application
Primarily a search tool
An administrative side to control database content
users web server database
evangelium.acs. ...
data data
![Page 17: Evangelium Nicodemi (a database application) Data Application Demonstration Next Steps ... 1 Ron.pdf · 2017-06-22 · Data Application Demonstration Next Steps Ron McFadyen University](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed395187ec1ed47a70d6644/html5/thumbnails/17.jpg)
17 / 26
Technical framework for application
Our development framework involves Webstorm, Meteor, JavaScript, Node, MongoDB
Node.js MongoDB JavaScript
JavaScript
Webstorm: provides an editing and execution environment for testing
Meteor: provides a framework for integrating JavaScript, Node, MongoDB, etc.
![Page 18: Evangelium Nicodemi (a database application) Data Application Demonstration Next Steps ... 1 Ron.pdf · 2017-06-22 · Data Application Demonstration Next Steps Ron McFadyen University](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed395187ec1ed47a70d6644/html5/thumbnails/18.jpg)
18 / 26
Example: user connects to application
User enters URL in web browser and chooses one of: Home, About, Search, Browse, Administration
evangelium.acs. ….
![Page 19: Evangelium Nicodemi (a database application) Data Application Demonstration Next Steps ... 1 Ron.pdf · 2017-06-22 · Data Application Demonstration Next Steps Ron McFadyen University](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed395187ec1ed47a70d6644/html5/thumbnails/19.jpg)
User enters criteria
Switzerland
Clicks Search button
Example: user constructs a search
19 / 26
![Page 20: Evangelium Nicodemi (a database application) Data Application Demonstration Next Steps ... 1 Ron.pdf · 2017-06-22 · Data Application Demonstration Next Steps Ron McFadyen University](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed395187ec1ed47a70d6644/html5/thumbnails/20.jpg)
20 / 26
Example: application responds with hits
![Page 21: Evangelium Nicodemi (a database application) Data Application Demonstration Next Steps ... 1 Ron.pdf · 2017-06-22 · Data Application Demonstration Next Steps Ron McFadyen University](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed395187ec1ed47a70d6644/html5/thumbnails/21.jpg)
21 / 26
Example: user sees more moving the mouse over a hit
![Page 22: Evangelium Nicodemi (a database application) Data Application Demonstration Next Steps ... 1 Ron.pdf · 2017-06-22 · Data Application Demonstration Next Steps Ron McFadyen University](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed395187ec1ed47a70d6644/html5/thumbnails/22.jpg)
22 / 26
Example: clicking a hit produces the complete entry
![Page 23: Evangelium Nicodemi (a database application) Data Application Demonstration Next Steps ... 1 Ron.pdf · 2017-06-22 · Data Application Demonstration Next Steps Ron McFadyen University](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed395187ec1ed47a70d6644/html5/thumbnails/23.jpg)
23 / 26
Evangelium Nicodemi,
a database application
DEMONSTRATION
![Page 24: Evangelium Nicodemi (a database application) Data Application Demonstration Next Steps ... 1 Ron.pdf · 2017-06-22 · Data Application Demonstration Next Steps Ron McFadyen University](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed395187ec1ed47a70d6644/html5/thumbnails/24.jpg)
24 / 26
Evangelium Nicodemi,
a database application
Next Steps
![Page 25: Evangelium Nicodemi (a database application) Data Application Demonstration Next Steps ... 1 Ron.pdf · 2017-06-22 · Data Application Demonstration Next Steps Ron McFadyen University](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed395187ec1ed47a70d6644/html5/thumbnails/25.jpg)
25 / 26
Next Steps
1. Complete the prototype
Implement more searching techniques
Complex search
Logical expresssions with and, or, not
Handling of dates (years)
Partial search
Search for word fragments
Make corrections to existing document entries
Adjust the document schema
tags, data types, structure, arrays
Add security to the Administration side
![Page 26: Evangelium Nicodemi (a database application) Data Application Demonstration Next Steps ... 1 Ron.pdf · 2017-06-22 · Data Application Demonstration Next Steps Ron McFadyen University](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed395187ec1ed47a70d6644/html5/thumbnails/26.jpg)
26 / 26
Next Steps
2. Evaluate
Consider a next iteration of prototype
If required implement in another database management system
e.g. PostgreSQL
3. Consider other database designs
Data warehousing ... Star schemas
Relational