TAC 2012Cold Start

Knowledge Base Population

Many slides borrowed from Jim Mayfield and Paul McNamee, JHU

When When Lisa'sLisa's mother mother Marge Marge SimpsonSimpson went to went to a weekend a weekend getaway at getaway at Rancho Relaxo, Rancho Relaxo, the movie The the movie The Happy Little Happy Little Elves Meet Fuzzy Elves Meet Fuzzy Snuggleduck was Snuggleduck was one of the R-one of the R-rated european rated european adult movies adult movies available on their available on their cable channels.cable channels.

When When Lisa'sLisa's mother mother Marge Marge SimpsonSimpson went to went to a weekend a weekend getaway at getaway at Rancho Relaxo, Rancho Relaxo, the movie The the movie The Happy Little Happy Little Elves Meet Fuzzy Elves Meet Fuzzy Snuggleduck was Snuggleduck was one of the R-one of the R-rated european rated european adult movies adult movies available on their available on their cable channels.cable channels.

After two years After two years in the academic in the academic quagmire of quagmire of Springfield Springfield ElementaryElementary, , LisaLisa finally has a finally has a teacher that she teacher that she connects with. connects with. But she soon But she soon learns that the learns that the problem with problem with being middle-being middle-class is thatclass is that

After two years After two years in the academic in the academic quagmire of quagmire of Springfield Springfield ElementaryElementary, , LisaLisa finally has a finally has a teacher that she teacher that she connects with. connects with. But she soon But she soon learns that the learns that the problem with problem with being middle-being middle-class is thatclass is that

Homer SimpsonHomer SimpsonHomer SimpsonHomer Simpson

Bart SimpsonBart SimpsonBart SimpsonBart SimpsonLisa SimpsonLisa SimpsonLisa SimpsonLisa Simpson

Marge SimpsonMarge SimpsonMarge SimpsonMarge Simpson

Springfield Springfield ElementaryElementarySpringfield Springfield ElementaryElementary

SpringfieldSpringfieldSpringfieldSpringfield

When When Lisa'sLisa's mother mother Marge Marge SimpsonSimpson went to went to a weekend a weekend getaway at getaway at Rancho Relaxo, Rancho Relaxo, the movie The the movie The Happy Little Happy Little Elves Meet Fuzzy Elves Meet Fuzzy Snuggleduck was Snuggleduck was one of the R-one of the R-rated european rated european adult movies adult movies available on their available on their cable channels.cable channels.

When When Lisa'sLisa's mother mother Marge Marge SimpsonSimpson went to went to a weekend a weekend getaway at getaway at Rancho Relaxo, Rancho Relaxo, the movie The the movie The Happy Little Happy Little Elves Meet Fuzzy Elves Meet Fuzzy Snuggleduck was Snuggleduck was one of the R-one of the R-rated european rated european adult movies adult movies available on their available on their cable channels.cable channels.

After two years After two years in the academic in the academic quagmire of quagmire of Springfield Springfield ElementaryElementary, , LisaLisa finally has a finally has a teacher that she teacher that she connects with. connects with. But she soon But she soon learns that the learns that the problem with problem with being middle-being middle-class is thatclass is that

After two years After two years in the academic in the academic quagmire of quagmire of Springfield Springfield ElementaryElementary, , LisaLisa finally has a finally has a teacher that she teacher that she connects with. connects with. But she soon But she soon learns that the learns that the problem with problem with being middle-being middle-class is thatclass is that

Homer SimpsonHomer SimpsonHomer SimpsonHomer Simpson

Bart SimpsonBart SimpsonBart SimpsonBart SimpsonLisa SimpsonLisa SimpsonLisa SimpsonLisa Simpson

Marge SimpsonMarge SimpsonMarge SimpsonMarge Simpson

Springfield Springfield ElementaryElementarySpringfield Springfield ElementaryElementary

SpringfieldSpringfieldSpringfieldSpringfield

Bottomless Pete, Nature’sCruelest Mistake

per:children per:children

per:alternate_namesper:cities_of_residence

per:spouse

per:schools_attended

When When Lisa'sLisa's mother mother Marge Marge SimpsonSimpson went to went to a weekend a weekend getaway at getaway at Rancho Relaxo, Rancho Relaxo, the movie The the movie The Happy Little Happy Little Elves Meet Fuzzy Elves Meet Fuzzy Snuggleduck was Snuggleduck was one of the R-one of the R-rated european rated european adult movies adult movies available on their available on their cable channels.cable channels.

When When Lisa'sLisa's mother mother Marge Marge SimpsonSimpson went to went to a weekend a weekend getaway at getaway at Rancho Relaxo, Rancho Relaxo, the movie The the movie The Happy Little Happy Little Elves Meet Fuzzy Elves Meet Fuzzy Snuggleduck was Snuggleduck was one of the R-one of the R-rated european rated european adult movies adult movies available on their available on their cable channels.cable channels.

After two years After two years in the academic in the academic quagmire of quagmire of Springfield Springfield ElementaryElementary, , LisaLisa finally has a finally has a teacher that she teacher that she connects with. connects with. But she soon But she soon learns that the learns that the problem with problem with being middle-being middle-class is thatclass is that

After two years After two years in the academic in the academic quagmire of quagmire of Springfield Springfield ElementaryElementary, , LisaLisa finally has a finally has a teacher that she teacher that she connects with. connects with. But she soon But she soon learns that the learns that the problem with problem with being middle-being middle-class is thatclass is that

Cold Start

SchemaSchemaSchemaSchema

Entity-Valued Relations

Relation Inverse(s)per:children per:parents

per:other_family per:other_family

per:parents per:children

per:siblings per:siblings

per:spouse per:spouse

per:employee_of {org,gpe}:employees*

per:member_of org:membership*

per:schools_attended org:students*

per:city_of_birth gpe:births_in_city*

per:stateorprovince_of_birth gpe:births_in_stateorprovince*

per:country_of_birth gpe:births_in_country*

per:cities_of_residence gpe:residents_of_city*

per:statesorprovinces_of_residence gpe:residents_of_stateorprovince

per:countries_of_residence gpe:residents_of_country*

per:city_of_death gpe:deaths_in_city*

per:stateorprovince_of_death gpe:deaths_in_stateorprovince*

per:country_of_death gpe:deaths_in_country*

org:shareholders {per,org,gpe}:holds_shares_in*

org:founded_by {per,org,gpe}:organizations_founded*

org:top_members_employees per:top_member_employee_of*

{org,gpe}:member_of org:members

org:members {org,gpe}:member_of

org:parents {org,gpe}:subsidiaries

org:subsidiaries org:parents

org:city_of_headquarters gpe:headquarters_in_city*

org:stateorprovince_of_headquarters gpe:headquarters_in_stateorprovince*

org:country_of_headquarters gpe:headquarters_in_country*

String-Filled Relationsper:alternate_names org:alternate_names

per:date_of_birth org:political_religious_affiliation

per:age org:number_of_employees_members

per:origin org:date_founded

per:date_of_death org:date_dissolved

per:cause_of_death org:website

per:title

per:religion

per:charges

Cold Start

SchemaSchemaper:childrenper:other_familyper:parentsper:siblingsper:spouseper:employee_ofper:member_ofper:schools_attendedper:city_of_birthper:stateorprovince_of_birthper:country_of_birthper:cities_of_residenceper:statesorprovinces_of_residenceper:countries_of_residenceper:city_of_deathper:stateorprovince_of_deathper:country_of_deathorg:shareholdersorg:founded_by

SchemaSchemaper:childrenper:other_familyper:parentsper:siblingsper:spouseper:employee_ofper:member_ofper:schools_attendedper:city_of_birthper:stateorprovince_of_birthper:country_of_birthper:cities_of_residenceper:statesorprovinces_of_residenceper:countries_of_residenceper:city_of_deathper:stateorprovince_of_deathper:country_of_deathorg:shareholdersorg:founded_by

The Task

SchemSchemaa

per:childrenper:other_familyper:parentsper:siblingsper:spouseper:employee_ofper:member_ofper:schools_attendedper:city_of_birthper:stateorprovince_of_birthper:country_of_birthper:cities_of_residenceper:statesorprovinces_of_residenceper:countries_of_residenceper:city_of_deathper:stateorprovince_of_deathper:country_of_deathorg:shareholdersorg:founded_by

SchemSchemaa

per:childrenper:other_familyper:parentsper:siblingsper:spouseper:employee_ofper:member_ofper:schools_attendedper:city_of_birthper:stateorprovince_of_birthper:country_of_birthper:cities_of_residenceper:statesorprovinces_of_residenceper:countries_of_residenceper:city_of_deathper:stateorprovince_of_deathper:country_of_deathorg:shareholdersorg:founded_by

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When Lisa's mother When Lisa's mother Marge Simpson Marge Simpson went to a weekend went to a weekend getaway at Rancho getaway at Rancho Relaxo, the movie Relaxo, the movie The Happy Little The Happy Little Elves Meet Fuzzy Elves Meet Fuzzy Snuggleduck was Snuggleduck was one of the R-rated one of the R-rated european adult european adult movies available on movies available on their cable their cable channels.channels.

When Lisa's mother When Lisa's mother Marge Simpson Marge Simpson went to a weekend went to a weekend getaway at Rancho getaway at Rancho Relaxo, the movie Relaxo, the movie The Happy Little The Happy Little Elves Meet Fuzzy Elves Meet Fuzzy Snuggleduck was Snuggleduck was one of the R-rated one of the R-rated european adult european adult movies available on movies available on their cable their cable channels.channels.

But wait,there’s more!!

You are given:

The Task

SchemSchemaa

per:childrenper:other_familyper:parentsper:siblingsper:spouseper:employee_ofper:member_ofper:schools_attendedper:city_of_birthper:stateorprovince_of_birthper:country_of_birthper:cities_of_residenceper:statesorprovinces_of_residenceper:countries_of_residenceper:city_of_deathper:stateorprovince_of_deathper:country_of_deathorg:shareholdersorg:founded_by

SchemSchemaa

per:childrenper:other_familyper:parentsper:siblingsper:spouseper:employee_ofper:member_ofper:schools_attendedper:city_of_birthper:stateorprovince_of_birthper:country_of_birthper:cities_of_residenceper:statesorprovinces_of_residenceper:countries_of_residenceper:city_of_deathper:stateorprovince_of_deathper:country_of_deathorg:shareholdersorg:founded_by

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'Lisa's mother s mother Marge SimpsonMarge Simpson went to a weekend went to a weekend getaway at Rancho getaway at Rancho Relaxo, the movie Relaxo, the movie The Happy Little The Happy Little Elves Meet Fuzzy Elves Meet Fuzzy Snuggleduck was Snuggleduck was one of the R-rated one of the R-rated european adult european adult movies available on movies available on their cable their cable channels.channels.

When When Lisa'Lisa's mother s mother Marge SimpsonMarge Simpson went to a weekend went to a weekend getaway at Rancho getaway at Rancho Relaxo, the movie Relaxo, the movie The Happy Little The Happy Little Elves Meet Fuzzy Elves Meet Fuzzy Snuggleduck was Snuggleduck was one of the R-rated one of the R-rated european adult european adult movies available on movies available on their cable their cable channels.channels.

LisaLisaMarge SimpsonMarge SimpsonRancho RelaxoRancho Relaxo

Fuzzy Fuzzy SnuggleduckSnuggleduck

LisaLisaMarge SimpsonMarge SimpsonRancho RelaxoRancho Relaxo

Fuzzy Fuzzy SnuggleduckSnuggleduck

You are given:

Homer SimpsonHomer SimpsonHomer SimpsonHomer Simpson

Bart SimpsonBart SimpsonBart SimpsonBart SimpsonLisa SimpsonLisa SimpsonLisa SimpsonLisa Simpson

Marge SimpsonMarge SimpsonMarge SimpsonMarge Simpson

Springfield Springfield ElementaryElementarySpringfield Springfield ElementaryElementary

SpringfieldSpringfieldSpringfieldSpringfield

Bottomless Pete, Nature’sCruelest Mistake

per:children per:children

per:alternate_namesper:cities_of_residence

per:spouse

per:schools_attended

SchemSchemaa

per:childrenper:other_familyper:parentsper:siblingsper:spouseper:employee_ofper:member_ofper:schools_attendedper:city_of_birthper:stateorprovince_of_birthper:country_of_birthper:cities_of_residenceper:statesorprovinces_of_residenceper:countries_of_residenceper:city_of_deathper:stateorprovince_of_deathper:country_of_deathorg:shareholdersorg:founded_by

SchemSchemaa

per:childrenper:other_familyper:parentsper:siblingsper:spouseper:employee_ofper:member_ofper:schools_attendedper:city_of_birthper:stateorprovince_of_birthper:country_of_birthper:cities_of_residenceper:statesorprovinces_of_residenceper:countries_of_residenceper:city_of_deathper:stateorprovince_of_deathper:country_of_deathorg:shareholdersorg:founded_by

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'sLisa's mother mother Marge SimpsonMarge Simpson went to a went to a weekend getaway at weekend getaway at Rancho Relaxo, the movie Rancho Relaxo, the movie The Happy Little Elves The Happy Little Elves Meet Fuzzy Snuggleduck Meet Fuzzy Snuggleduck was one of the R-rated was one of the R-rated european adult movies european adult movies available on their cable available on their cable channels.channels.

When When Lisa'Lisa's mother s mother Marge SimpsonMarge Simpson went to a weekend went to a weekend getaway at Rancho getaway at Rancho Relaxo, the movie Relaxo, the movie The Happy Little The Happy Little Elves Meet Fuzzy Elves Meet Fuzzy Snuggleduck was Snuggleduck was one of the R-rated one of the R-rated european adult european adult movies available on movies available on their cable their cable channels.channels.

When When Lisa'Lisa's mother s mother Marge SimpsonMarge Simpson went to a weekend went to a weekend getaway at Rancho getaway at Rancho Relaxo, the movie Relaxo, the movie The Happy Little The Happy Little Elves Meet Fuzzy Elves Meet Fuzzy Snuggleduck was Snuggleduck was one of the R-rated one of the R-rated european adult european adult movies available on movies available on their cable their cable channels.channels.

You Must Produce:

Homer SimpsonHomer SimpsonHomer SimpsonHomer Simpson

Bart SimpsonBart SimpsonBart SimpsonBart SimpsonLisa SimpsonLisa SimpsonLisa SimpsonLisa Simpson

Marge SimpsonMarge SimpsonMarge SimpsonMarge Simpson

Springfield Springfield ElementaryElementarySpringfield Springfield ElementaryElementary

SpringfieldSpringfieldSpringfieldSpringfield

Bottomless Pete, Nature’sCruelest Mistake

per:children per:children

per:alternate_namesper:cities_of_residence

per:spouse

per:schools_attended

How do you knowthat your KB is any good?

Homer SimpsonHomer SimpsonHomer SimpsonHomer Simpson

Bart SimpsonBart SimpsonBart SimpsonBart SimpsonLisa SimpsonLisa SimpsonLisa SimpsonLisa Simpson

Marge SimpsonMarge SimpsonMarge SimpsonMarge Simpson

Springfield Springfield ElementaryElementarySpringfield Springfield ElementaryElementary

SpringfieldSpringfieldSpringfieldSpringfield

Bottomless Pete, Nature’sCruelest Mistake

per:children per:children

per:alternate_namesper:cities_of_residence

per:spouse

per:schools_attended

How do you knowthat your KB is any good?

Align it to a groundtruth KB☞

How do you knowthat your KB is any good?

Align it to a groundtruth KB☞

But how are you going to But how are you going to produce ground truth? And produce ground truth? And wouldnwouldn’’t the alignment be t the alignment be intractable anyway if the intractable anyway if the

KB were of any reasonable KB were of any reasonable size?size?

But how are you going to But how are you going to produce ground truth? And produce ground truth? And wouldnwouldn’’t the alignment be t the alignment be intractable anyway if the intractable anyway if the

KB were of any reasonable KB were of any reasonable size?size?

Homer SimpsonHomer SimpsonHomer SimpsonHomer Simpson

Bart SimpsonBart SimpsonBart SimpsonBart SimpsonLisa SimpsonLisa SimpsonLisa SimpsonLisa Simpson

Marge SimpsonMarge SimpsonMarge SimpsonMarge Simpson

Springfield Springfield ElementaryElementarySpringfield Springfield ElementaryElementary

SpringfieldSpringfieldSpringfieldSpringfield

Bottomless Pete, Nature’sCruelest Mistake

per:children per:children

per:alternate_namesper:cities_of_residence

per:spouse

per:schools_attended

Where did the children ofMarge Simpson go to school?

per:childrenper:schools_attended

Homer SimpsonHomer SimpsonHomer SimpsonHomer Simpson

Bart SimpsonBart SimpsonBart SimpsonBart SimpsonLisa SimpsonLisa SimpsonLisa SimpsonLisa Simpson

Marge SimpsonMarge SimpsonMarge SimpsonMarge Simpson

Springfield Springfield ElementaryElementarySpringfield Springfield ElementaryElementary

SpringfieldSpringfieldSpringfieldSpringfield

Bottomless Pete, Nature’sCruelest Mistake

per:children per:children

per:alternate_namesper:cities_of_residence

per:spouse

per:schools_attended

When When Lisa'sLisa's mother mother Marge Marge SimpsonSimpson went to went to a weekend a weekend getaway at getaway at Rancho Relaxo, Rancho Relaxo, the movie The the movie The Happy Little Happy Little Elves Meet Fuzzy Elves Meet Fuzzy Snuggleduck was Snuggleduck was one of the R-one of the R-rated european rated european adult movies adult movies available on their available on their cable channels.cable channels.

When When Lisa'sLisa's mother mother Marge Marge SimpsonSimpson went to went to a weekend a weekend getaway at getaway at Rancho Relaxo, Rancho Relaxo, the movie The the movie The Happy Little Happy Little Elves Meet Fuzzy Elves Meet Fuzzy Snuggleduck was Snuggleduck was one of the R-one of the R-rated european rated european adult movies adult movies available on their available on their cable channels.cable channels.

After two years After two years in the academic in the academic quagmire of quagmire of Springfield Springfield ElementaryElementary, , LisaLisa finally has a finally has a teacher that she teacher that she connects with. connects with. But she soon But she soon learns that the learns that the problem with problem with being middle-being middle-class is thatclass is that

After two years After two years in the academic in the academic quagmire of quagmire of Springfield Springfield ElementaryElementary, , LisaLisa finally has a finally has a teacher that she teacher that she connects with. connects with. But she soon But she soon learns that the learns that the problem with problem with being middle-being middle-class is thatclass is that

Query Entity First RelationSecond Relation

Adriana Petryna per:title

Blackstone Group org:founded_by

William Shoreper:organizations_fou

ndedorg:date_founded

Wistar Institute org:employees per:title

Andrew W. Mellon per:childrenper:organizations_fou

nded

Lycee Alliance Israelite Universelle

org:employees per:schools_attended

Tsitsi Jaji per:schools_attended org:students

Sample Evaluation Queries

6 November 2012

KBP-09

Pipeline

serif /facetsserif

/facets

.xml

s2ts2t

.tac1

.fac1facetsfille

rfacetsfille

r

.fac_out

altnamesaltnames

.altnames

.tac2

jackknife –r –c –p jackknife –r –c –p

.tac3

topempltopempl rmerrorsrmerrors.tac4 ValidateC

oldStart.pl

ValidateColdStart.p

l

.tac5.tac3a

cullassertions

cullassertions

.tac6jackknife –m –p

jackknife –m –p rmerrorsrmerrors

.tac8RequireInverses.plRequireInverses.pl

.tac9.tac7

ValidateColdStart.p

l

ValidateColdStart.p

l

.tac10

timex2timex2.tac11

Freshly minted KBFreshly minted KB

CorpusCorpus

CALECALE

CUNYCUNY

6 November 2012

KBP-09

Practice: Washington Post articles

26k 2010 Washington Post articles (194k assertions)26k 2010 Washington Post articles (194k assertions)

6 November 2012

KBP-09

Demo: Query Engine

Since no training data was available, we assessed our practice KBs qualitatively

26k 2010 Washington Post articles (194k assertions)26k 2010 Washington Post articles (194k assertions)

6 November 2012

KBP-09

Good KELVIN

Jared Fogle is an employee of Subway Freeman Hrabowski works for UMBC, founded the

Meyerhoff Scholors Program, and attended both Hampton University and the University of Illinois

Elena Kagan attended Oxford, Harvard, and Princeton

The Applied Physics Laboratory is a subsidiary of Johns Hopkins University

Southwest Airlines is headquartered in Texas

26k 2010 Washington Post articles (194k assertions)26k 2010 Washington Post articles (194k assertions)

6 November 2012

KBP-09

Bad KELVIN

Harry Reid is an employee of the Republican Party. (KELVIN also learns he is employee of the Democratic Party) Tend to see more trouble with popular entities

Big Foot is an employee of Starbucks Steven Spielberg lives in Iran Jill Biden is married to Jill Biden

26k 2010 Washington Post articles (194k assertions)26k 2010 Washington Post articles (194k assertions)

6 November 2012

KBP-09

1 year of WP = 1 computer scientist

KELVIN learns: ("ian soboroff”) per:employee_of ("national institute of

standards and technology") ("ian soboroff") per:title "computer scientist”

paulmac@hpcc1: more WPB_ENG_20100506.0012.sgm One scholar Anderson has been talking with is Dan Cohen, the

director of the Center for History and New Media at George Mason University; another is Ian Soboroff, a computer scientist with the National Institute of Standards and Technology, who studies how well technology works with human language. Soboroff hopes that in the future, Twitter can be used to help researchers understand how information was dispersed and what human networks in the early 21st century looked like.

6 November 2012

KBP-09

Experimental Results

CUNY CALE P R F1 P R F1

hltcoe1 0.5256 0.2843 0.3690 0.1620 0.2182 0.1859

hltcoe2 YES 0.4929 0.3031 0.3753 0.1818 0.2406 0.2071

hltcoe3 YES 0.4865 0.5000 0.4932 0.1849 0.3510 0.2423

hltcoe4 YES YES 0.4799 0.5155 0.4971 0.1842 0.4168 0.2555

hltcoe5 YES 0.4937 0.3053 0.3773 0.1453 0.2531 0.1846

0-hop slots 1-hop slots

CALE (better entity linking) materially improves recall CALE (better entity linking) materially improves recall

Precision (unsurprisingly) is lower for 0-hop vs. 1-hopPrecision (unsurprisingly) is lower for 0-hop vs. 1-hop

6 November 2012

KBP-09

Jena RDF databaseJena RDF database

Fuseki RDF triple store

query service

Fuseki RDF triple store

query service

Pubby RDF

linked data

Browser

Pubby RDF

linked data

Browser

Text search

interface

Text search

interface

6 November 2012

KBP-09

Some reasoning usecases

Deriving new relations and propertieshusband_of(X,Y) => male(X)

Default reasoningreligion(X,R) ^ member(X,C) ^ church(C) ^ unknown(affiliation(C,?)) => affiliation(C,R)

Detecting inconsistenciesbirthDate(X,D1) ^ deathDate(X,D2) ^ before(D2,D1)

Detecting unusual or anomalous dataA person with more than 10 children

Providing evidence for/against entity merging