newspell: easy management of complex spell data · newspell: easy management of complex spell data...
TRANSCRIPT
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
NEWSPELL:Easy management of complex spell data
Hannes Kroger
European University Institute, Florence
07.06.2013
Hannes Kroger NEWSPELL 1/24
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
Who might use NEWSPELL?
Cutting off spells
Combining Spells
Filling in Missing Information
What else?
Hannes Kroger NEWSPELL 2/24
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
Outline
Who might use NEWSPELL?
Cutting off spells
Combining Spells
Filling in Missing Information
What else?
Hannes Kroger NEWSPELL 3/24
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
Who would benefit from using NEWSPELL?
I Users unfamiliar with data management
I Experienced users who want to save coding time
I Double checking own code
Hannes Kroger NEWSPELL 4/24
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
Who would benefit from using NEWSPELL?
I Users unfamiliar with data management
I Experienced users who want to save coding time
I Double checking own code
Hannes Kroger NEWSPELL 4/24
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
Who would benefit from using NEWSPELL?
I Users unfamiliar with data management
I Experienced users who want to save coding time
I Double checking own code
Hannes Kroger NEWSPELL 4/24
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
An example of complex spell structure1
23
45
67
89
1011
10 20 30 40 50 60 70 80Age
Education FT Emp. PT Emp. UnemploymentRetired Other No Information
Hannes Kroger NEWSPELL 5/24
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
Main features of NEWSPELL
I Cutting off overlapping spells according to a ranking
I Different states at the same time might indicate a new type ofspell
I Missing information can be filled in with information frombefore and after the spell
Hannes Kroger NEWSPELL 6/24
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
Main features of NEWSPELL
I Cutting off overlapping spells according to a ranking
I Different states at the same time might indicate a new type ofspell
I Missing information can be filled in with information frombefore and after the spell
Hannes Kroger NEWSPELL 6/24
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
Main features of NEWSPELL
I Cutting off overlapping spells according to a ranking
I Different states at the same time might indicate a new type ofspell
I Missing information can be filled in with information frombefore and after the spell
Hannes Kroger NEWSPELL 6/24
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
Outline
Who might use NEWSPELL?
Cutting off spells
Combining Spells
Filling in Missing Information
What else?
Hannes Kroger NEWSPELL 7/24
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
Problem with overlapping spells?
I Some methods require one state per time unit: e.g. sequenceanalysis
I Overlapping spells create a problem
I newspell rank command can deal with the problem
Hannes Kroger NEWSPELL 8/24
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
Problem with overlapping spells?
I Some methods require one state per time unit: e.g. sequenceanalysis
I Overlapping spells create a problem
I newspell rank command can deal with the problem
Hannes Kroger NEWSPELL 8/24
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
Problem with overlapping spells?
I Some methods require one state per time unit: e.g. sequenceanalysis
I Overlapping spells create a problem
I newspell rank command can deal with the problem
Hannes Kroger NEWSPELL 8/24
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
One individual’s employment status over the life course1
23
45
67
89
1011
10 20 30 40 50 60 70 80Age
Education FT Emp. PT Emp. UnemploymentRetired Other No Information
Hannes Kroger NEWSPELL 9/24
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
NEWSPELL RANK
newspell rank, rank(4,1,2,3,5,6,99) /**/ id(pid) stype(stype) snumber(n) begin(begin) end(end) /**/ nspellnr(n2) sort(begin)
Hannes Kroger NEWSPELL 10/24
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
One state per time point remains
12
34
56
78
910
11
10 20 30 40 50 60 70 80Age
Education FT Emp. PT Emp. UnemploymentRetired Other No Information
12
34
56
78
910
11
12
10 20 30 40 50 60 70 80Age
Education FT Emp. PT Emp. UnemploymentRetired Other No Information
Hannes Kroger NEWSPELL 11/24
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
Outline
Who might use NEWSPELL?
Cutting off spells
Combining Spells
Filling in Missing Information
What else?
Hannes Kroger NEWSPELL 12/24
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
Overlaps might indicate a new spell type1
23
45
67
89
1011
10 20 30 40 50 60 70 80Age
Education FT Emp. PT Emp. UnemploymentRetired Other No Information
Hannes Kroger NEWSPELL 13/24
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
NEWSPELL COMBINE
newspell combine, combine(3 5) ncode(7) /**/ id(pid) stype(stype) snumber(n) begin(begin) end(end) /**/ nspellnr(n2) sort(begin)
Hannes Kroger NEWSPELL 14/24
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
Two overlapping spells form one new spell
12
34
56
78
910
11
10 20 30 40 50 60 70 80Age
Education FT Emp. PT Emp. UnemploymentRetired Other No Information
12
34
56
78
910
11
10 20 30 40 50 60 70 80Age
Education FT Emp. PT Emp. UnemploymentRetired Other Work+retired No Information
Hannes Kroger NEWSPELL 15/24
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
Outline
Who might use NEWSPELL?
Cutting off spells
Combining Spells
Filling in Missing Information
What else?
Hannes Kroger NEWSPELL 16/24
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
For some periods information is missing1
23
45
67
89
1011
10 20 30 40 50 60 70 80Age
Education FT Emp. PT Emp. UnemploymentRetired Other No Information
Hannes Kroger NEWSPELL 17/24
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
NEWSPELL FILLIN
newspell fillin, fill(99, both) rank(5,3) /**/ id(pid) stype(stype) snumber(n) begin(begin) end(end)/*nspellnr(n2) sort(begin)
Hannes Kroger NEWSPELL 18/24
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
MI spell is filled from previous spell
12
34
56
78
910
11
10 20 30 40 50 60 70 80Age
Education FT Emp. PT Emp. UnemploymentRetired Other No Information
12
34
56
78
910
10 20 30 40 50 60 70 80Age
Education FT Emp. PT Emp. UnemploymentRetired Other No Information
Hannes Kroger NEWSPELL 19/24
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
Outline
Who might use NEWSPELL?
Cutting off spells
Combining Spells
Filling in Missing Information
What else?
Hannes Kroger NEWSPELL 20/24
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
NEWSPELL can even do more!
NEWSPELL can also:
I Transform spell into long/wide format (overlapping or not)newspell tolong, newspell towide
I Different spell types can be merged togethernewspell merge
Hannes Kroger NEWSPELL 21/24
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
NEWSPELL can even do more!
NEWSPELL can also:
I Transform spell into long/wide format (overlapping or not)newspell tolong, newspell towide
I Different spell types can be merged togethernewspell merge
Hannes Kroger NEWSPELL 21/24
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
What is left to do?
I Descriptive overview of spell data set
I More detailed help file with examples
I BETA release
Hannes Kroger NEWSPELL 22/24
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
What is left to do?
I Descriptive overview of spell data set
I More detailed help file with examples
I BETA release
Hannes Kroger NEWSPELL 22/24
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
What is left to do?
I Descriptive overview of spell data set
I More detailed help file with examples
I BETA release
Hannes Kroger NEWSPELL 22/24
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
Thanks to Sebastian Beil, Ruhr-Universitat Bochum, fortesting NEWSPELL!
Hannes Kroger NEWSPELL 23/24
Who might use NEWSPELL?Cutting off spellsCombining Spells
Filling in Missing InformationWhat else?
What are your questions andcomments?
Hannes Kroger NEWSPELL 24/24