reading metadata between the lines: searching for stories, people, places and more in television...
DESCRIPTION
(Check out the “Notes” section for explanation about each slide.) A presentation given at the Lucene/Solr Revolution 2014 conference to discuss metadata search in television news for the NewsScape project. Please also visit http://bitly.com/lsr2014tvnews for updates. Video: Coming soon! Summary: UCLA’s NewsScape has over 200,000 hours of television news from the United States and Europe. In the last two years, the project has generated a large set of “metadata”: story segment boundaries, story types and topics, name entities, on-screen text, image labels, etc. Including them in searches opens new opportunities for research, understanding, and visualization, and helps answer questions such as “Who were interviewed on which shows about the Ukraine crisis in May 2014” and “What text or image is shown on the screen as a story is being reported”. However, metadata search poses significant challenges, because the search engine needs to consider not only the content, but also its position and time relative to other metadata instances, whether search terms are found in the same or different metadata instances, etc. This session will describe how UCLA has implemented metadata search with Lucene/Solr’s block join and custom query types, as well as the collection’s position-time data. This talk will also describe UCLA’s work on using time as the distance unit for proximity search and filtering search results by metadata boundaries as well as their metadata-aware, multi-field implementation of auto-suggest.TRANSCRIPT
![Page 1: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/1.jpg)
Reading Metadata
Between the Lines:
Searching for
Stories, People, Places and More
in Television News
Kai Chan
Social Sciences Computing
University of California, Los Angeles
![Page 2: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/2.jpg)
What?
![Page 3: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/3.jpg)
What We Do with Television News
![Page 4: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/4.jpg)
Make Metadata Searchable
![Page 5: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/5.jpg)
Make Metadata Searchable
captionTHESE RECALLED CARS ARE AMONG
THE MOST POPULAR FOR THE PAST 12
YEARS.
![Page 6: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/6.jpg)
Make Metadata Searchable
caption(searchable)
THESE RECALLED CARS ARE AMONG
THE MOST POPULAR FOR THE PAST 12
YEARS.
![Page 7: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/7.jpg)
Make Metadata Searchable
metadata
caption(searchable)
THESE RECALLED CARS ARE AMONG
THE MOST POPULAR FOR THE PAST 12
YEARS.
![Page 8: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/8.jpg)
Make Metadata Searchable
metadata(not searchable)
caption(searchable)
THESE RECALLED CARS ARE AMONG
THE MOST POPULAR FOR THE PAST 12
YEARS.
![Page 9: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/9.jpg)
Story Segment
Story 1 Story 2
![Page 10: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/10.jpg)
Story Segment
![Page 11: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/11.jpg)
Name Entity
Name: John McCainRole: US SenatorParty: Republican
Name: Greta Van SusterenRole: AnchorNetwork: Fox News Channel
![Page 12: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/12.jpg)
Name Entity
NJ Governor: cooperation from US President “outstanding”, “deserves great credit”
Republican Democrat praise (!)
![Page 13: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/13.jpg)
Non-Verbal Communication
![Page 14: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/14.jpg)
Non-Verbal Communication
![Page 15: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/15.jpg)
On-Screen Text
![Page 16: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/16.jpg)
On-Screen Text
![Page 17: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/17.jpg)
How?
![Page 18: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/18.jpg)
1. Help Users Search
![Page 19: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/19.jpg)
Define Metadata Structure
Tag Attribute Name: Value
Attribute Name: Value
Attribute Name: Value
Start Time End Time
![Page 20: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/20.jpg)
Define Metadata Structure
SEG Type: Headline
Topic: Ebola Scare
Country: US
1:00:00 1:03:00
(story segment)
start time end time tag attributes
![Page 21: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/21.jpg)
Search in Multiple Places
![Page 22: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/22.jpg)
Offer Suggestions
![Page 23: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/23.jpg)
2. Make the Search Happen
![Page 24: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/24.jpg)
Map to Documents and Fields
SEG_Topic: Ebola Scare
NER_Name: John McCain
NER_Role: Senator
fields
SEG_Type: Headline
(program info, caption)
document
NER_State: Arizona
![Page 25: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/25.jpg)
Map to Documents and Fields
SEG_Topic: Ebola Scare
NER_Name: John McCain
NER_Role: Senator
fields
SEG_Type: Headline
(program info, caption)
document
NER_State: Arizona
NER_Name: John Chiang
NER_Role: Controller
NER_State: California
SEG_Topic: Drought
SEG_Type: Politics
![Page 26: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/26.jpg)
Define Semantics
+TEXT_Text:“drought”
+NER_Role:“Senator”
+NER_State:“California”
Query:
![Page 27: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/27.jpg)
Define Semantics
Interpretation 1:
“drought”
time
start end
Role: Senator State: California
start end
![Page 28: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/28.jpg)
Define Semantics
Interpretation 2:
“drought”
time
start end start end
“drought”
Role: Senator State: California
![Page 29: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/29.jpg)
Define Semantics
Interpretation 3:
“drought”
time
start end
Role: Senator
State: California
![Page 30: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/30.jpg)
Define Semantics
Interpretation 4:
“drought”
time
start end
Role: Senator
State: California
![Page 31: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/31.jpg)
Map to Documents and Fields
SEG_Topic: Ebola Scare
NER_Name: John McCain
NER_Role: Senator
fields
SEG_Type: Headline
(program info, caption)
document
NER_State: Arizona
NER_Name: John Chiang
NER_Role: Controller
NER_State: California
SEG_Topic: Drought
SEG_Type: Politics
![Page 32: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/32.jpg)
Map to Documents and Fields
SEG_Topic: Ebola Scare
NER_Name: John McCain
NER_Role: Senator
fields
SEG_Type: Headline
(program info, caption)
document
NER_State: Arizona
NER_Name: John Chiang
NER_Role: Controller
NER_State: California
SEG_Topic: Drought
SEG_Type: Politics
![Page 33: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/33.jpg)
Map to Documents and Fields
SEG_Topic: Ebola Scare
NER_Name: John McCain
NER_Role: Senator
fields
SEG_Type: Headline
(program info, caption)
document
NER_State: Arizona
NER_Name: John Chiang
NER_Role: Controller
NER_State: California
SEG_Topic: Drought
SEG_Type: Politics
![Page 34: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/34.jpg)
Map to Documents and Fields
SEG_Topic: Ebola Scare
NER_Name: John McCain
NER_Role: Senator
fields
SEG_Type: Headline
(program info, caption)
document
NER_State: Arizona
NER_Name: John Chiang
NER_Role: Controller
NER_State: California
SEG_Topic: Drought
SEG_Type: Politics
![Page 35: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/35.jpg)
Map to Documents and Fields
SEG_Topic: Ebola Scare
NER_Name: John McCain
NER_Role: Senator
fields
SEG_Type: Headline
(program info, caption)
document
NER_State: Arizona
NER_Name: John Chiang
NER_Role: Controller
NER_State: California
SEG_Topic: Drought
SEG_Type: Politics
![Page 36: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/36.jpg)
Map to Documents and Fields
SEG_Topic: Ebola Scare
NER_Name: John McCain
NER_Role: Senator
fields
SEG_Type: Headline
(program info, caption)
document
NER_State: Arizona
NER_Name: John Chiang
NER_Role: Controller
NER_State: California
SEG_Topic: Drought
SEG_Type: Politics
![Page 37: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/37.jpg)
Map to Documents and Fields
SEG_Topic: Ebola Scare
NER_Name: John McCain
NER_Role: Senator
fields
SEG_Type: Headline
(program info, caption)
document
NER_State: Arizona
NER_Name: John Chiang
NER_Role: Controller
NER_State: California
SEG_Topic: Drought
SEG_Type: Politics
![Page 38: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/38.jpg)
3. Make the Search Meaningful
![Page 39: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/39.jpg)
Two Levels of Document
programdocument
tag document
tag document
tag document
1 document= 1 metadata instance
![Page 40: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/40.jpg)
Two Levels of Document
programdocument
tag document
tag document
tag document
1 document= 1 news program
![Page 41: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/41.jpg)
Two Levels of Document
programdocument
tag document
tag document
tag document
1. search metadata content
![Page 42: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/42.jpg)
Two Levels of Document
programdocument
tag document
tag document
tag document
2. lookup program document(s)
![Page 43: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/43.jpg)
Two Levels of Document
programdocument
tag document
tag document
tag document
3. filter by program information
![Page 44: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/44.jpg)
Two Levels of Document
NER_Role: Senator
NER_State: Arizona
tag document
NER_Role: Senator
tag document tag document
Tag: NER
NER_State: California
Tag: NER Tag: NER
NER_Role: Controller
NER_State: California
matchNOT match NOT match
![Page 45: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/45.jpg)
Two Levels of Document
Date
Network
Show
program document
NER_Role: Senator
tag document
Tag: NER
NER_State: California
![Page 46: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/46.jpg)
Filter by Metadata Boundaries
“drought”
time
start end
“drought”“drought”
Role: Governor
State: California
![Page 47: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/47.jpg)
Filter by Metadata Boundaries
...
EMERGENCY PLED TO THE STATE
OF CALIFORNIA IN MAY TO
CONSERVE WATER.
>> THIS DROUGHT IS A BIG
WAKE-UP CALL, A REMINDER.
THE COUPLE SAYS
THAT THEY NEED NO
REMINDERS.
...
36:18
36:22 36:18 – 36:22Tag: NERName: Jerry BrownRole: GovernorState: California
36:19
![Page 48: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/48.jpg)
4. Make the Search More Powerful
![Page 49: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/49.jpg)
Proximity Search – Word as Unit
...
>> THIS DROUGHT IS A BIG
WAKE-UP CALL, A REMINDER.
THE COUPLE SAYS
THAT THEY NEED NO
REMINDERS
THEY DO ADMIT THAT THEIR
LAWN HAS BECOME A BIT
UNSIGHTLY.
...
position 100
position 121
20 words
![Page 50: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/50.jpg)
Proximity Search – Time as Unit
...
>> THIS DROUGHT IS A BIG
WAKE-UP CALL, A REMINDER.
THE COUPLE SAYS
THAT THEY NEED NO
REMINDERS
THEY DO ADMIT THAT THEIR
LAWN HAS BECOME A BIT
UNSIGHTLY.
...
36:19
36:25
6 s
![Page 51: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/51.jpg)
Make Metadata Searchable
metadata(not searchable)
caption(searchable)
THESE RECALLED CARS ARE AMONG
THE MOST POPULAR FOR THE PAST 12
YEARS.
![Page 52: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/52.jpg)
Make Metadata Searchable – Accomplished
metadata(now searchable)
caption(searchable)
THESE RECALLED CARS ARE AMONG
THE MOST POPULAR FOR THE PAST 12
YEARS.
![Page 53: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/53.jpg)
Thank you for coming!
Questions or comments?My e-mail: [email protected]
Slides available at:http://bit.ly/lsr2014tvnews(or scan this barcode)
![Page 54: Reading Metadata between the Lines: Searching for Stories, People, Places and More in Television News](https://reader035.vdocuments.us/reader035/viewer/2022081404/559447a31a28ab0f0d8b463c/html5/thumbnails/54.jpg)