diversity-aware search for people, content, events and diversity-aware hiring and evaluation
DESCRIPTION
My presentation at the LiquidPub Trust workshop http://interdisciplines.org/conferences/Workshop-on-Trust-and-ReputationTRANSCRIPT
![Page 1: Diversity-aware search for people, content, events AND Diversity-aware hiring and evaluation](https://reader035.vdocuments.us/reader035/viewer/2022062511/54c2eba24a795990308b4586/html5/thumbnails/1.jpg)
Trusting Differently: Diversity-aware search for people, content, events
Trusting Differently: Diversity-aware search for people, content, events
Judith Simon, Institut Nicod, CNRS
Aliaksandr Birukou, University of Trento, Italy
[Insert header here][Insert footer]
1
![Page 2: Diversity-aware search for people, content, events AND Diversity-aware hiring and evaluation](https://reader035.vdocuments.us/reader035/viewer/2022062511/54c2eba24a795990308b4586/html5/thumbnails/2.jpg)
Motivation
o Information overload
o Paradoxically - Narrowing the scope
o People tend to (implicitly) trust known content, people, events
“See only what you want to see, hear only what you want to hear, read only what you want to read” Cass Sunstein
"It's what you don't know that can kill you” J. Mullins
“The scarce resource now is the attention” Bernardo Huberman
[Insert header here][Insert footer]
2
![Page 3: Diversity-aware search for people, content, events AND Diversity-aware hiring and evaluation](https://reader035.vdocuments.us/reader035/viewer/2022062511/54c2eba24a795990308b4586/html5/thumbnails/3.jpg)
Question 1 - What is your discipline?
o Computer Science: 24
o Social sciences: 2
o Philosophy: 3
o Sociology of science: 1
o Physical systems: 1
o Unknown: 2
[Insert header here][Insert footer]
3
![Page 4: Diversity-aware search for people, content, events AND Diversity-aware hiring and evaluation](https://reader035.vdocuments.us/reader035/viewer/2022062511/54c2eba24a795990308b4586/html5/thumbnails/4.jpg)
Question 2
o How many of you met people from another discipline working on trust before?
[Insert header here][Insert footer]
4
![Page 5: Diversity-aware search for people, content, events AND Diversity-aware hiring and evaluation](https://reader035.vdocuments.us/reader035/viewer/2022062511/54c2eba24a795990308b4586/html5/thumbnails/5.jpg)
Scientific entities
o People: researchers, readers
o Content: papers, articles, datasets, blogs,
o Events: conferences, workshops, summer schools
o …plus publication venues: journals, newspapers, magazines, open repositories
[Insert header here][Insert footer]
5/13
![Page 6: Diversity-aware search for people, content, events AND Diversity-aware hiring and evaluation](https://reader035.vdocuments.us/reader035/viewer/2022062511/54c2eba24a795990308b4586/html5/thumbnails/6.jpg)
Dimensions of content
oRelevance
oReputation
o…
[Insert header here][Insert footer]
6/13
![Page 7: Diversity-aware search for people, content, events AND Diversity-aware hiring and evaluation](https://reader035.vdocuments.us/reader035/viewer/2022062511/54c2eba24a795990308b4586/html5/thumbnails/7.jpg)
One more dimension - diversity
[Insert header here][Insert footer]
7
![Page 8: Diversity-aware search for people, content, events AND Diversity-aware hiring and evaluation](https://reader035.vdocuments.us/reader035/viewer/2022062511/54c2eba24a795990308b4586/html5/thumbnails/8.jpg)
Roadmap
o Fix two out of three dimensions: o Relevance – metrics from information retrievalo Reputation – based on links or citations
o Design diversity metrics:o Existing research on diversity in web searcho Community network of scientific entities
o Apply resultso To discover hidden links between scientific entitieso To analyze and avoid conflicts of interest
[Insert header here][Insert footer]
8
![Page 9: Diversity-aware search for people, content, events AND Diversity-aware hiring and evaluation](https://reader035.vdocuments.us/reader035/viewer/2022062511/54c2eba24a795990308b4586/html5/thumbnails/9.jpg)
Desired outcome
o A recommender system thato Recommends content, events, people to researchers
o Matches papers with reviewerso To get diverse viewpoints on the same paper
o Assigns papers to panels/sessions with different degrees of similarity/diversityo To increase homogeneity or have more vivid discussion
[Insert header here][Insert footer]
9/13
![Page 10: Diversity-aware search for people, content, events AND Diversity-aware hiring and evaluation](https://reader035.vdocuments.us/reader035/viewer/2022062511/54c2eba24a795990308b4586/html5/thumbnails/10.jpg)
What we need
o Topic discoveryo … e.g., by keyphrase extraction
o Trust and reputation metricso … but we are probably in the right place
[Insert header here][Insert footer]
10/13
![Page 11: Diversity-aware search for people, content, events AND Diversity-aware hiring and evaluation](https://reader035.vdocuments.us/reader035/viewer/2022062511/54c2eba24a795990308b4586/html5/thumbnails/11.jpg)
Thanks for your attentionThanks for your attention
Contact me at [email protected]
[Insert header here][Insert footer]
11
![Page 12: Diversity-aware search for people, content, events AND Diversity-aware hiring and evaluation](https://reader035.vdocuments.us/reader035/viewer/2022062511/54c2eba24a795990308b4586/html5/thumbnails/12.jpg)
Diversity-aware hiring in scienceDiversity-aware hiring in science
Aliaksandr Birukou, University of Trento, Italy
Fabio Casati, University of Trento, Italy
[Insert header here][Insert footer]
12
![Page 13: Diversity-aware search for people, content, events AND Diversity-aware hiring and evaluation](https://reader035.vdocuments.us/reader035/viewer/2022062511/54c2eba24a795990308b4586/html5/thumbnails/13.jpg)
Motivation
o You’ve seen that already…
o Now, consider hiring committees
o Same problems – select people similar to you/group/department
[Insert header here][Insert footer]
13/13
![Page 14: Diversity-aware search for people, content, events AND Diversity-aware hiring and evaluation](https://reader035.vdocuments.us/reader035/viewer/2022062511/54c2eba24a795990308b4586/html5/thumbnails/14.jpg)
Argument
o Hiring people different from the ones already working in the research group, department, or university can bring new contacts, viewpoints and communitieso But only if the person has all required competences
[Insert header here][Insert footer]
14/13
![Page 15: Diversity-aware search for people, content, events AND Diversity-aware hiring and evaluation](https://reader035.vdocuments.us/reader035/viewer/2022062511/54c2eba24a795990308b4586/html5/thumbnails/15.jpg)
o Culture includes:o experienceo [patterns of] behavioro knowledgeo beliefso normso …
o Culture is:o sharedo accummulated o learned o socially transmittedo socially acquiredo …
Defining culture. Content vs. its properties
Aliaksandr Birukou - Implicit Culture Framework for behavior transfer
15
that are
and
TraitsTraits
transmittedtransmitted
sharedshared
CultureCultureCultureCulture
=
![Page 16: Diversity-aware search for people, content, events AND Diversity-aware hiring and evaluation](https://reader035.vdocuments.us/reader035/viewer/2022062511/54c2eba24a795990308b4586/html5/thumbnails/16.jpg)
Metrics on scientific/cultural difference
o Scientific traits: where publish, research interests, …
o Culture traits: experience, patterns of behaviors, beliefs, knowledge, …
o Metrics can be based on the differences between “the culture” of an individual and the research group/department:o Common culture (culture overlap) is the set of traits that is present in
both cultureso Culture similarity is the degree to which two cultures are similar, i.e.
how much they have in commono Culture fit is the ratio between the culture overlap and the number of
traits in the other culture
[Insert header here][Insert footer]
16/13
![Page 17: Diversity-aware search for people, content, events AND Diversity-aware hiring and evaluation](https://reader035.vdocuments.us/reader035/viewer/2022062511/54c2eba24a795990308b4586/html5/thumbnails/17.jpg)
Judging people from other communities
o Improve the reputation of a stranger by showing where she stays in her community (top 5%/bottom 10%)
[Insert header here][Insert footer]
17/13
![Page 18: Diversity-aware search for people, content, events AND Diversity-aware hiring and evaluation](https://reader035.vdocuments.us/reader035/viewer/2022062511/54c2eba24a795990308b4586/html5/thumbnails/18.jpg)
But…
o How do you define “top 5%” or “bottom 10%”?
[Insert header here][Insert footer]
18/13
![Page 19: Diversity-aware search for people, content, events AND Diversity-aware hiring and evaluation](https://reader035.vdocuments.us/reader035/viewer/2022062511/54c2eba24a795990308b4586/html5/thumbnails/19.jpg)
uCount
o Community-defined index
o The goal is to put in place a merit-based, objective, transparent system for assessing people, contributions, and events, one that does not simply focus on "impact" but focuses on the wide range of contributions that can be made
o Will be maintained by ICST and EAI
o Please volunteer to become a member of the uCount council
[Insert header here][Insert footer]
19/13
![Page 20: Diversity-aware search for people, content, events AND Diversity-aware hiring and evaluation](https://reader035.vdocuments.us/reader035/viewer/2022062511/54c2eba24a795990308b4586/html5/thumbnails/20.jpg)
Call for members of uCount council
o What is requiredo Willingness to help your community to design better metrics,
metrics that mattero Some spare time to define selection procedures, tools for
community interactiono Some spare time for involving your community in finding what
matters for them (see Dumas et al – correlation between metrics)
o Timelineo Expression of interest: by January 4th
o Involving your community: by January 30th
[Insert header here][Insert footer]
20/13
![Page 21: Diversity-aware search for people, content, events AND Diversity-aware hiring and evaluation](https://reader035.vdocuments.us/reader035/viewer/2022062511/54c2eba24a795990308b4586/html5/thumbnails/21.jpg)
More
o The LiquidPub project. http://project.liquidpub.org
o Google liquidpub-announce and subscribe if you are interested (VERY low traffic): http://disi.unitn.it/mailman/listinfo/liquidpub-announce
o Or, subscribe to our blog: http://liquidpub.wordpress.com
o Or, follow us on twitter: http://twitter.com/liquidpub