enrico motta a , francesco osborne a ,b a kmi , the open university, united kingdom
DESCRIPTION
Making Sense of Research. Enrico Motta a , Francesco Osborne a ,b a KMi , The Open University, United Kingdom b Dept . of Computer Science, University of Turin, Italy. Hats I wear…. Researcher Research Manager Supervisor/Mentor Editor-in-chief of a journal - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Enrico Motta a , Francesco Osborne a ,b a KMi , The Open University, United Kingdom](https://reader034.vdocuments.us/reader034/viewer/2022051402/568165f0550346895dd918a2/html5/thumbnails/1.jpg)
Enrico Mottaa, Francesco Osbornea,b
aKMi, The Open University, United KingdombDept. of Computer Science, University of Turin,
Italy
Making Sense of Research
![Page 2: Enrico Motta a , Francesco Osborne a ,b a KMi , The Open University, United Kingdom](https://reader034.vdocuments.us/reader034/viewer/2022051402/568165f0550346895dd918a2/html5/thumbnails/2.jpg)
Hats I wear….
• Researcher
• Research Manager
• Supervisor/Mentor
• Editor-in-chief of a journal
• Advisor to strategic research programmes
• etc
2
![Page 3: Enrico Motta a , Francesco Osborne a ,b a KMi , The Open University, United Kingdom](https://reader034.vdocuments.us/reader034/viewer/2022051402/568165f0550346895dd918a2/html5/thumbnails/3.jpg)
Tasks
• Academic Expert Search. – E.g., “find me researchers with expertise in both Social Networks and
Semantic Web, with at least some publications in CHI and ISWC, with more than 15 years research experience, a h-index greater than 15, etc”
• Understanding Research Dynamics– E.g., as EiC, I often need to make a decision about proposals for a special
issue in a particular topic. This requires to understand whether the area is ‘hot’ right now or is decreasing in importance, who are the key people and groups, etc..
3
![Page 4: Enrico Motta a , Francesco Osborne a ,b a KMi , The Open University, United Kingdom](https://reader034.vdocuments.us/reader034/viewer/2022051402/568165f0550346895dd918a2/html5/thumbnails/4.jpg)
Exploring scholarly data: a variety of options….
4
![Page 5: Enrico Motta a , Francesco Osborne a ,b a KMi , The Open University, United Kingdom](https://reader034.vdocuments.us/reader034/viewer/2022051402/568165f0550346895dd918a2/html5/thumbnails/5.jpg)
Lack of comprehensive and integrated support
“There is still a need for an integrated solution, where the different functionalities and visualizations are provided in a coherent manner, through an environment able to support a seamless navigation between the different views and functionalities”
Dunne et al., 2012
5
![Page 6: Enrico Motta a , Francesco Osborne a ,b a KMi , The Open University, United Kingdom](https://reader034.vdocuments.us/reader034/viewer/2022051402/568165f0550346895dd918a2/html5/thumbnails/6.jpg)
Digital library perspective
• Tools tend to focus on traditional library search tasks, such as publication search and citation services, and are simply not designed for supporting exploration/sensemaking tasks or expert search (in particular highly-faceted expert search)– This is not just a claim, we verified it with a rigorous empirical study!
6
![Page 7: Enrico Motta a , Francesco Osborne a ,b a KMi , The Open University, United Kingdom](https://reader034.vdocuments.us/reader034/viewer/2022051402/568165f0550346895dd918a2/html5/thumbnails/7.jpg)
Lack of a semantic treatment of research topics
• Current tools do not treat research topics as ‘first class citizens’. – E.g., a tool may support a keyword search for papers on Ontology
Matching, but by and large tools do not ‘understand’ that Ontology Matching is actually a research area
• Crucially, understanding what is a research area also means understanding what is not a research area– E.g., “case study” is often used as a tag for papers, but it is not actually a
research area
7
![Page 8: Enrico Motta a , Francesco Osborne a ,b a KMi , The Open University, United Kingdom](https://reader034.vdocuments.us/reader034/viewer/2022051402/568165f0550346895dd918a2/html5/thumbnails/8.jpg)
Relations between research areas
8
Ontology Matching
Ontology Engineering Information Integration
Ontology Alignment Ontology Mapping
subAreaOf
sameAs
![Page 9: Enrico Motta a , Francesco Osborne a ,b a KMi , The Open University, United Kingdom](https://reader034.vdocuments.us/reader034/viewer/2022051402/568165f0550346895dd918a2/html5/thumbnails/9.jpg)
Very high level research fields
This journal has nothing to do with my research areas
KB and KBS arethe same researcharea
Case Study is not aresearch area
Only co-autorshipis provided
Old name for IJHCS(changed long ago!)
![Page 10: Enrico Motta a , Francesco Osborne a ,b a KMi , The Open University, United Kingdom](https://reader034.vdocuments.us/reader034/viewer/2022051402/568165f0550346895dd918a2/html5/thumbnails/10.jpg)
ACM and other similar classifications
• The relations between entries are unclear– They are meant to be sub-areas, but for many of them it can be argued that they are not really
sub-areas
• The different types of relationships are not distinguished
• Rather shallow– Most areas we know about are not listed – e.g., only 4 topics are classified under Semantic Web
• Static, manually defined, hence they get obsolete very quickly
![Page 11: Enrico Motta a , Francesco Osborne a ,b a KMi , The Open University, United Kingdom](https://reader034.vdocuments.us/reader034/viewer/2022051402/568165f0550346895dd918a2/html5/thumbnails/11.jpg)
11
Exploring Scholarly Data
![Page 12: Enrico Motta a , Francesco Osborne a ,b a KMi , The Open University, United Kingdom](https://reader034.vdocuments.us/reader034/viewer/2022051402/568165f0550346895dd918a2/html5/thumbnails/12.jpg)
Mining scholarly relations with Klink• Klink takes as input a corpus of publications, annotated with
keywords– Keywords can be user generated or can be automatically extracted from the
abstract or the full text of the publication– We currently use a corpus of about 20M computer science publications
obtained from a variety of sources
• Tidies up the set of keywords by removing keywords that do not denote a research area – e.g., “case study” or “NeOn Project”.
• Automatically computes three types of semantic relationships between the identified research areas.
• Returns a KB of semantic relationships between research areas
![Page 13: Enrico Motta a , Francesco Osborne a ,b a KMi , The Open University, United Kingdom](https://reader034.vdocuments.us/reader034/viewer/2022051402/568165f0550346895dd918a2/html5/thumbnails/13.jpg)
13
Relations mined by Klink
• Skos:broaderGeneric (A, B) – A is a sub-area of B.– E.g., “Semantic Web Services” is a sub-area of “Web Services”
• relatedEquivalent (A, B) – A and B are normally used to denote the same research area. – E.g., “Ontology Matching” and “Ontology Mapping” denote the same area
• contributesTo (A, B) – The outputs from area A are relevant to research in area B. – E.g., Research in “Ontology Engineering” contributes to research in
“Semantic Web”
![Page 14: Enrico Motta a , Francesco Osborne a ,b a KMi , The Open University, United Kingdom](https://reader034.vdocuments.us/reader034/viewer/2022051402/568165f0550346895dd918a2/html5/thumbnails/14.jpg)
From a corpus of 15M
papers accessed through
the MAS API Klink identified
about 1500 research topics
and structured them by
means of almost 3000
semantic relationships
![Page 15: Enrico Motta a , Francesco Osborne a ,b a KMi , The Open University, United Kingdom](https://reader034.vdocuments.us/reader034/viewer/2022051402/568165f0550346895dd918a2/html5/thumbnails/15.jpg)
Rexplore: some snapshots
![Page 16: Enrico Motta a , Francesco Osborne a ,b a KMi , The Open University, United Kingdom](https://reader034.vdocuments.us/reader034/viewer/2022051402/568165f0550346895dd918a2/html5/thumbnails/16.jpg)
Researchers in the 5-15 career range with expertise in both semantic web and social networks, with publications in at least one of {CHI, ISWC, WWW), ranked with respect to the impact of their work in these two areas (using harmonic mean)
Expert Search (1a)
![Page 17: Enrico Motta a , Francesco Osborne a ,b a KMi , The Open University, United Kingdom](https://reader034.vdocuments.us/reader034/viewer/2022051402/568165f0550346895dd918a2/html5/thumbnails/17.jpg)
Graph view of main researchers identified in previous slide, linking them to their main co-authors.
The diameter of a node reflects the h-index of the researcher
Expert Search (1b)
![Page 18: Enrico Motta a , Francesco Osborne a ,b a KMi , The Open University, United Kingdom](https://reader034.vdocuments.us/reader034/viewer/2022051402/568165f0550346895dd918a2/html5/thumbnails/18.jpg)
Expert Search (2)
Career-young (1-5) people who have co-authored with Enrico and have expertise in machine learning, ranked in terms of #publications in this topic
![Page 19: Enrico Motta a , Francesco Osborne a ,b a KMi , The Open University, United Kingdom](https://reader034.vdocuments.us/reader034/viewer/2022051402/568165f0550346895dd918a2/html5/thumbnails/19.jpg)
Normalised impact per topic over time
19
![Page 20: Enrico Motta a , Francesco Osborne a ,b a KMi , The Open University, United Kingdom](https://reader034.vdocuments.us/reader034/viewer/2022051402/568165f0550346895dd918a2/html5/thumbnails/20.jpg)
Shared Research Trajectories
The authors who are most similar to Enrico with respect to the evolution of their research interests over time.
![Page 21: Enrico Motta a , Francesco Osborne a ,b a KMi , The Open University, United Kingdom](https://reader034.vdocuments.us/reader034/viewer/2022051402/568165f0550346895dd918a2/html5/thumbnails/21.jpg)
21
![Page 22: Enrico Motta a , Francesco Osborne a ,b a KMi , The Open University, United Kingdom](https://reader034.vdocuments.us/reader034/viewer/2022051402/568165f0550346895dd918a2/html5/thumbnails/22.jpg)
Where are SW authors going?...
![Page 23: Enrico Motta a , Francesco Osborne a ,b a KMi , The Open University, United Kingdom](https://reader034.vdocuments.us/reader034/viewer/2022051402/568165f0550346895dd918a2/html5/thumbnails/23.jpg)
23
![Page 24: Enrico Motta a , Francesco Osborne a ,b a KMi , The Open University, United Kingdom](https://reader034.vdocuments.us/reader034/viewer/2022051402/568165f0550346895dd918a2/html5/thumbnails/24.jpg)
24
![Page 25: Enrico Motta a , Francesco Osborne a ,b a KMi , The Open University, United Kingdom](https://reader034.vdocuments.us/reader034/viewer/2022051402/568165f0550346895dd918a2/html5/thumbnails/25.jpg)
25
Conclusions (1)
• Rexplore provides an integrated and comprehensive solution to support the exploration and analysis of scholarly data
• It does so by integrating a semantic foundation with statistical and visual analytics solutions
![Page 26: Enrico Motta a , Francesco Osborne a ,b a KMi , The Open University, United Kingdom](https://reader034.vdocuments.us/reader034/viewer/2022051402/568165f0550346895dd918a2/html5/thumbnails/26.jpg)
26
Conclusions (2)
• The fine-grained structure of research topics generated by Klink supports– Expert search, trend analysis, and exploration at a very fine grained
level of granularity– The definition of fine-grained impact metrics, such as “citations in
topics” or “normalised impact with respect to topic”, which allow users to measure very specific elements of academic impact
![Page 27: Enrico Motta a , Francesco Osborne a ,b a KMi , The Open University, United Kingdom](https://reader034.vdocuments.us/reader034/viewer/2022051402/568165f0550346895dd918a2/html5/thumbnails/27.jpg)
27
Conclusions (3)
• A rigorous empirical evaluation confirmed that:– Existing off the shelf tools, e.g., Google Scholar and Microsoft Academic
Search, are not geared to support scholarly tasks beyond basic search for authors and publications
– In contrast with these tools, Rexplore effectively supports complex sensemaking and expert search tasks. 94% of the testers described Rexplore as “very effective”
– Rexplore exhibits a high degree of performance also with respect to tasks proposed by the users themselves (88% success). This confirms a high degree of breadth and flexibility in the functionalities provided by the system.
![Page 28: Enrico Motta a , Francesco Osborne a ,b a KMi , The Open University, United Kingdom](https://reader034.vdocuments.us/reader034/viewer/2022051402/568165f0550346895dd918a2/html5/thumbnails/28.jpg)
Current Work
• R&D– Providing better support for analysing the impact and characteristics of
groups of researchers, thus going beyond individual-centric analysis• ‘Group’ here is a very generic notion, it can refer to all OU academics, all the
people working on Ontology Design, all the people whose research interests are similar to Enrico’s, etc.
– Improving disambiguation of authors and topics
• Exploitation– Discussions are ongoing with a variety of users (in the public and
commercial sector) related to the deployment of customised versions of Rexplore
28
![Page 29: Enrico Motta a , Francesco Osborne a ,b a KMi , The Open University, United Kingdom](https://reader034.vdocuments.us/reader034/viewer/2022051402/568165f0550346895dd918a2/html5/thumbnails/29.jpg)