![Page 1: NEWSPELL: Easy management of complex spell data · NEWSPELL: Easy management of complex spell data ... I Di erent states at the same time might indicate a new type of spell ... I](https://reader034.vdocuments.us/reader034/viewer/2022051800/5ad7f1fb7f8b9a9d5c8cb331/html5/thumbnails/1.jpg)
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
NEWSPELL:Easy management of complex spell data
Hannes Kroger
European University Institute, Florence
07.06.2013
Hannes Kroger NEWSPELL 1/24
![Page 2: NEWSPELL: Easy management of complex spell data · NEWSPELL: Easy management of complex spell data ... I Di erent states at the same time might indicate a new type of spell ... I](https://reader034.vdocuments.us/reader034/viewer/2022051800/5ad7f1fb7f8b9a9d5c8cb331/html5/thumbnails/2.jpg)
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
Who might use NEWSPELL?
Cutting off spells
Combining Spells
Filling in Missing Information
What else?
Hannes Kroger NEWSPELL 2/24
![Page 3: NEWSPELL: Easy management of complex spell data · NEWSPELL: Easy management of complex spell data ... I Di erent states at the same time might indicate a new type of spell ... I](https://reader034.vdocuments.us/reader034/viewer/2022051800/5ad7f1fb7f8b9a9d5c8cb331/html5/thumbnails/3.jpg)
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
Outline
Who might use NEWSPELL?
Cutting off spells
Combining Spells
Filling in Missing Information
What else?
Hannes Kroger NEWSPELL 3/24
![Page 4: NEWSPELL: Easy management of complex spell data · NEWSPELL: Easy management of complex spell data ... I Di erent states at the same time might indicate a new type of spell ... I](https://reader034.vdocuments.us/reader034/viewer/2022051800/5ad7f1fb7f8b9a9d5c8cb331/html5/thumbnails/4.jpg)
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
Who would benefit from using NEWSPELL?
I Users unfamiliar with data management
I Experienced users who want to save coding time
I Double checking own code
Hannes Kroger NEWSPELL 4/24
![Page 5: NEWSPELL: Easy management of complex spell data · NEWSPELL: Easy management of complex spell data ... I Di erent states at the same time might indicate a new type of spell ... I](https://reader034.vdocuments.us/reader034/viewer/2022051800/5ad7f1fb7f8b9a9d5c8cb331/html5/thumbnails/5.jpg)
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
Who would benefit from using NEWSPELL?
I Users unfamiliar with data management
I Experienced users who want to save coding time
I Double checking own code
Hannes Kroger NEWSPELL 4/24
![Page 6: NEWSPELL: Easy management of complex spell data · NEWSPELL: Easy management of complex spell data ... I Di erent states at the same time might indicate a new type of spell ... I](https://reader034.vdocuments.us/reader034/viewer/2022051800/5ad7f1fb7f8b9a9d5c8cb331/html5/thumbnails/6.jpg)
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
Who would benefit from using NEWSPELL?
I Users unfamiliar with data management
I Experienced users who want to save coding time
I Double checking own code
Hannes Kroger NEWSPELL 4/24
![Page 7: NEWSPELL: Easy management of complex spell data · NEWSPELL: Easy management of complex spell data ... I Di erent states at the same time might indicate a new type of spell ... I](https://reader034.vdocuments.us/reader034/viewer/2022051800/5ad7f1fb7f8b9a9d5c8cb331/html5/thumbnails/7.jpg)
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
An example of complex spell structure1
23
45
67
89
1011
10 20 30 40 50 60 70 80Age
Education FT Emp. PT Emp. UnemploymentRetired Other No Information
Hannes Kroger NEWSPELL 5/24
![Page 8: NEWSPELL: Easy management of complex spell data · NEWSPELL: Easy management of complex spell data ... I Di erent states at the same time might indicate a new type of spell ... I](https://reader034.vdocuments.us/reader034/viewer/2022051800/5ad7f1fb7f8b9a9d5c8cb331/html5/thumbnails/8.jpg)
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
Main features of NEWSPELL
I Cutting off overlapping spells according to a ranking
I Different states at the same time might indicate a new type ofspell
I Missing information can be filled in with information frombefore and after the spell
Hannes Kroger NEWSPELL 6/24
![Page 9: NEWSPELL: Easy management of complex spell data · NEWSPELL: Easy management of complex spell data ... I Di erent states at the same time might indicate a new type of spell ... I](https://reader034.vdocuments.us/reader034/viewer/2022051800/5ad7f1fb7f8b9a9d5c8cb331/html5/thumbnails/9.jpg)
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
Main features of NEWSPELL
I Cutting off overlapping spells according to a ranking
I Different states at the same time might indicate a new type ofspell
I Missing information can be filled in with information frombefore and after the spell
Hannes Kroger NEWSPELL 6/24
![Page 10: NEWSPELL: Easy management of complex spell data · NEWSPELL: Easy management of complex spell data ... I Di erent states at the same time might indicate a new type of spell ... I](https://reader034.vdocuments.us/reader034/viewer/2022051800/5ad7f1fb7f8b9a9d5c8cb331/html5/thumbnails/10.jpg)
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
Main features of NEWSPELL
I Cutting off overlapping spells according to a ranking
I Different states at the same time might indicate a new type ofspell
I Missing information can be filled in with information frombefore and after the spell
Hannes Kroger NEWSPELL 6/24
![Page 11: NEWSPELL: Easy management of complex spell data · NEWSPELL: Easy management of complex spell data ... I Di erent states at the same time might indicate a new type of spell ... I](https://reader034.vdocuments.us/reader034/viewer/2022051800/5ad7f1fb7f8b9a9d5c8cb331/html5/thumbnails/11.jpg)
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
Outline
Who might use NEWSPELL?
Cutting off spells
Combining Spells
Filling in Missing Information
What else?
Hannes Kroger NEWSPELL 7/24
![Page 12: NEWSPELL: Easy management of complex spell data · NEWSPELL: Easy management of complex spell data ... I Di erent states at the same time might indicate a new type of spell ... I](https://reader034.vdocuments.us/reader034/viewer/2022051800/5ad7f1fb7f8b9a9d5c8cb331/html5/thumbnails/12.jpg)
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
Problem with overlapping spells?
I Some methods require one state per time unit: e.g. sequenceanalysis
I Overlapping spells create a problem
I newspell rank command can deal with the problem
Hannes Kroger NEWSPELL 8/24
![Page 13: NEWSPELL: Easy management of complex spell data · NEWSPELL: Easy management of complex spell data ... I Di erent states at the same time might indicate a new type of spell ... I](https://reader034.vdocuments.us/reader034/viewer/2022051800/5ad7f1fb7f8b9a9d5c8cb331/html5/thumbnails/13.jpg)
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
Problem with overlapping spells?
I Some methods require one state per time unit: e.g. sequenceanalysis
I Overlapping spells create a problem
I newspell rank command can deal with the problem
Hannes Kroger NEWSPELL 8/24
![Page 14: NEWSPELL: Easy management of complex spell data · NEWSPELL: Easy management of complex spell data ... I Di erent states at the same time might indicate a new type of spell ... I](https://reader034.vdocuments.us/reader034/viewer/2022051800/5ad7f1fb7f8b9a9d5c8cb331/html5/thumbnails/14.jpg)
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
Problem with overlapping spells?
I Some methods require one state per time unit: e.g. sequenceanalysis
I Overlapping spells create a problem
I newspell rank command can deal with the problem
Hannes Kroger NEWSPELL 8/24
![Page 15: NEWSPELL: Easy management of complex spell data · NEWSPELL: Easy management of complex spell data ... I Di erent states at the same time might indicate a new type of spell ... I](https://reader034.vdocuments.us/reader034/viewer/2022051800/5ad7f1fb7f8b9a9d5c8cb331/html5/thumbnails/15.jpg)
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
One individual’s employment status over the life course1
23
45
67
89
1011
10 20 30 40 50 60 70 80Age
Education FT Emp. PT Emp. UnemploymentRetired Other No Information
Hannes Kroger NEWSPELL 9/24
![Page 16: NEWSPELL: Easy management of complex spell data · NEWSPELL: Easy management of complex spell data ... I Di erent states at the same time might indicate a new type of spell ... I](https://reader034.vdocuments.us/reader034/viewer/2022051800/5ad7f1fb7f8b9a9d5c8cb331/html5/thumbnails/16.jpg)
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
NEWSPELL RANK
newspell rank, rank(4,1,2,3,5,6,99) /**/ id(pid) stype(stype) snumber(n) begin(begin) end(end) /**/ nspellnr(n2) sort(begin)
Hannes Kroger NEWSPELL 10/24
![Page 17: NEWSPELL: Easy management of complex spell data · NEWSPELL: Easy management of complex spell data ... I Di erent states at the same time might indicate a new type of spell ... I](https://reader034.vdocuments.us/reader034/viewer/2022051800/5ad7f1fb7f8b9a9d5c8cb331/html5/thumbnails/17.jpg)
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
One state per time point remains
12
34
56
78
910
11
10 20 30 40 50 60 70 80Age
Education FT Emp. PT Emp. UnemploymentRetired Other No Information
12
34
56
78
910
11
12
10 20 30 40 50 60 70 80Age
Education FT Emp. PT Emp. UnemploymentRetired Other No Information
Hannes Kroger NEWSPELL 11/24
![Page 18: NEWSPELL: Easy management of complex spell data · NEWSPELL: Easy management of complex spell data ... I Di erent states at the same time might indicate a new type of spell ... I](https://reader034.vdocuments.us/reader034/viewer/2022051800/5ad7f1fb7f8b9a9d5c8cb331/html5/thumbnails/18.jpg)
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
Outline
Who might use NEWSPELL?
Cutting off spells
Combining Spells
Filling in Missing Information
What else?
Hannes Kroger NEWSPELL 12/24
![Page 19: NEWSPELL: Easy management of complex spell data · NEWSPELL: Easy management of complex spell data ... I Di erent states at the same time might indicate a new type of spell ... I](https://reader034.vdocuments.us/reader034/viewer/2022051800/5ad7f1fb7f8b9a9d5c8cb331/html5/thumbnails/19.jpg)
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
Overlaps might indicate a new spell type1
23
45
67
89
1011
10 20 30 40 50 60 70 80Age
Education FT Emp. PT Emp. UnemploymentRetired Other No Information
Hannes Kroger NEWSPELL 13/24
![Page 20: NEWSPELL: Easy management of complex spell data · NEWSPELL: Easy management of complex spell data ... I Di erent states at the same time might indicate a new type of spell ... I](https://reader034.vdocuments.us/reader034/viewer/2022051800/5ad7f1fb7f8b9a9d5c8cb331/html5/thumbnails/20.jpg)
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
NEWSPELL COMBINE
newspell combine, combine(3 5) ncode(7) /**/ id(pid) stype(stype) snumber(n) begin(begin) end(end) /**/ nspellnr(n2) sort(begin)
Hannes Kroger NEWSPELL 14/24
![Page 21: NEWSPELL: Easy management of complex spell data · NEWSPELL: Easy management of complex spell data ... I Di erent states at the same time might indicate a new type of spell ... I](https://reader034.vdocuments.us/reader034/viewer/2022051800/5ad7f1fb7f8b9a9d5c8cb331/html5/thumbnails/21.jpg)
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
Two overlapping spells form one new spell
12
34
56
78
910
11
10 20 30 40 50 60 70 80Age
Education FT Emp. PT Emp. UnemploymentRetired Other No Information
12
34
56
78
910
11
10 20 30 40 50 60 70 80Age
Education FT Emp. PT Emp. UnemploymentRetired Other Work+retired No Information
Hannes Kroger NEWSPELL 15/24
![Page 22: NEWSPELL: Easy management of complex spell data · NEWSPELL: Easy management of complex spell data ... I Di erent states at the same time might indicate a new type of spell ... I](https://reader034.vdocuments.us/reader034/viewer/2022051800/5ad7f1fb7f8b9a9d5c8cb331/html5/thumbnails/22.jpg)
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
Outline
Who might use NEWSPELL?
Cutting off spells
Combining Spells
Filling in Missing Information
What else?
Hannes Kroger NEWSPELL 16/24
![Page 23: NEWSPELL: Easy management of complex spell data · NEWSPELL: Easy management of complex spell data ... I Di erent states at the same time might indicate a new type of spell ... I](https://reader034.vdocuments.us/reader034/viewer/2022051800/5ad7f1fb7f8b9a9d5c8cb331/html5/thumbnails/23.jpg)
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
For some periods information is missing1
23
45
67
89
1011
10 20 30 40 50 60 70 80Age
Education FT Emp. PT Emp. UnemploymentRetired Other No Information
Hannes Kroger NEWSPELL 17/24
![Page 24: NEWSPELL: Easy management of complex spell data · NEWSPELL: Easy management of complex spell data ... I Di erent states at the same time might indicate a new type of spell ... I](https://reader034.vdocuments.us/reader034/viewer/2022051800/5ad7f1fb7f8b9a9d5c8cb331/html5/thumbnails/24.jpg)
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
NEWSPELL FILLIN
newspell fillin, fill(99, both) rank(5,3) /**/ id(pid) stype(stype) snumber(n) begin(begin) end(end)/*nspellnr(n2) sort(begin)
Hannes Kroger NEWSPELL 18/24
![Page 25: NEWSPELL: Easy management of complex spell data · NEWSPELL: Easy management of complex spell data ... I Di erent states at the same time might indicate a new type of spell ... I](https://reader034.vdocuments.us/reader034/viewer/2022051800/5ad7f1fb7f8b9a9d5c8cb331/html5/thumbnails/25.jpg)
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
MI spell is filled from previous spell
12
34
56
78
910
11
10 20 30 40 50 60 70 80Age
Education FT Emp. PT Emp. UnemploymentRetired Other No Information
12
34
56
78
910
10 20 30 40 50 60 70 80Age
Education FT Emp. PT Emp. UnemploymentRetired Other No Information
Hannes Kroger NEWSPELL 19/24
![Page 26: NEWSPELL: Easy management of complex spell data · NEWSPELL: Easy management of complex spell data ... I Di erent states at the same time might indicate a new type of spell ... I](https://reader034.vdocuments.us/reader034/viewer/2022051800/5ad7f1fb7f8b9a9d5c8cb331/html5/thumbnails/26.jpg)
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
Outline
Who might use NEWSPELL?
Cutting off spells
Combining Spells
Filling in Missing Information
What else?
Hannes Kroger NEWSPELL 20/24
![Page 27: NEWSPELL: Easy management of complex spell data · NEWSPELL: Easy management of complex spell data ... I Di erent states at the same time might indicate a new type of spell ... I](https://reader034.vdocuments.us/reader034/viewer/2022051800/5ad7f1fb7f8b9a9d5c8cb331/html5/thumbnails/27.jpg)
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
NEWSPELL can even do more!
NEWSPELL can also:
I Transform spell into long/wide format (overlapping or not)newspell tolong, newspell towide
I Different spell types can be merged togethernewspell merge
Hannes Kroger NEWSPELL 21/24
![Page 28: NEWSPELL: Easy management of complex spell data · NEWSPELL: Easy management of complex spell data ... I Di erent states at the same time might indicate a new type of spell ... I](https://reader034.vdocuments.us/reader034/viewer/2022051800/5ad7f1fb7f8b9a9d5c8cb331/html5/thumbnails/28.jpg)
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
NEWSPELL can even do more!
NEWSPELL can also:
I Transform spell into long/wide format (overlapping or not)newspell tolong, newspell towide
I Different spell types can be merged togethernewspell merge
Hannes Kroger NEWSPELL 21/24
![Page 29: NEWSPELL: Easy management of complex spell data · NEWSPELL: Easy management of complex spell data ... I Di erent states at the same time might indicate a new type of spell ... I](https://reader034.vdocuments.us/reader034/viewer/2022051800/5ad7f1fb7f8b9a9d5c8cb331/html5/thumbnails/29.jpg)
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
What is left to do?
I Descriptive overview of spell data set
I More detailed help file with examples
I BETA release
Hannes Kroger NEWSPELL 22/24
![Page 30: NEWSPELL: Easy management of complex spell data · NEWSPELL: Easy management of complex spell data ... I Di erent states at the same time might indicate a new type of spell ... I](https://reader034.vdocuments.us/reader034/viewer/2022051800/5ad7f1fb7f8b9a9d5c8cb331/html5/thumbnails/30.jpg)
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
What is left to do?
I Descriptive overview of spell data set
I More detailed help file with examples
I BETA release
Hannes Kroger NEWSPELL 22/24
![Page 31: NEWSPELL: Easy management of complex spell data · NEWSPELL: Easy management of complex spell data ... I Di erent states at the same time might indicate a new type of spell ... I](https://reader034.vdocuments.us/reader034/viewer/2022051800/5ad7f1fb7f8b9a9d5c8cb331/html5/thumbnails/31.jpg)
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
What is left to do?
I Descriptive overview of spell data set
I More detailed help file with examples
I BETA release
Hannes Kroger NEWSPELL 22/24
![Page 32: NEWSPELL: Easy management of complex spell data · NEWSPELL: Easy management of complex spell data ... I Di erent states at the same time might indicate a new type of spell ... I](https://reader034.vdocuments.us/reader034/viewer/2022051800/5ad7f1fb7f8b9a9d5c8cb331/html5/thumbnails/32.jpg)
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
Thanks to Sebastian Beil, Ruhr-Universitat Bochum, fortesting NEWSPELL!
Hannes Kroger NEWSPELL 23/24
![Page 33: NEWSPELL: Easy management of complex spell data · NEWSPELL: Easy management of complex spell data ... I Di erent states at the same time might indicate a new type of spell ... I](https://reader034.vdocuments.us/reader034/viewer/2022051800/5ad7f1fb7f8b9a9d5c8cb331/html5/thumbnails/33.jpg)
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
What are your questions andcomments?
Hannes Kroger NEWSPELL 24/24