is+is: vorlesung szientometrie ... · scientometrics – problems with the impact factor •...
TRANSCRIPT
Scientometrics, Research Information Systems
Vorlesung�
HansUszkoreit&Brigi1eJörg
Szientometrie, Wissenschaftsinformationssysteme
Scientometrics, Research Information Systems
Scientometrics
“Scientometricsisthescienceofmeasuringandanalysingscience.
Inprac8ce,scientometricsiso:endoneusingbibliometricsthatismeasurementof(scien8fic)publica8ons.”
(Wikipedia,July2009)
Scientometrics, Research Information Systems
Scientometrics – some relevant dates • 1665:FirstJournal:„PhilosophicalTransac;onsoftheRoyalSociety“inLondon• 1665:French„JournalScavans“(ratherscien;ficjournalism)• 18thCentury:largelybasedonpersonalcommunica;ons• Late18thCentury:emergenceofcita;onsfromthespecific
organisa;onofthesciences• 19thCentury:furtherins;tu;onaliza;onofScience;
referencestoauthors,opposedtoiden;fableanddatedtexts(later)• 1910:emergenceofcita;onsascurrentlyunderstood• Early20thCentury:substan;algrowthofscienceac;vi;es• 1940s+1950s:ins;tu;onalphaseofsciencepolicy,regularappearanceof
fundingacknowledgementsandIns;tu;onaladdressesinpublica;ons• 1960:Founda;onofISI(Ins;tuteforScien;ficInforma;on)
establishingtheScienceCita;onIndex(SCI)andwithit,theImpactFactorasameasurementofScience
• …theImpactFactor(basedonISI‘sdatabase)iss8llthedominantmeasureforperformanceofScience
• …butthisisabouttochangewiththe‚OpenAccess‘era• …otherIndexesappear,Hirsch‐Index,downloadmetrics,...
• h1p://www.arl.org/resources/pubs/mmproceedings/138guedon.shtml• h1p://eprints.ecs.soton.ac.uk/17142/4/scientometproofs.pdf
ICT
‐
Technology
Scientometrics, Research Information Systems
Scientometrics – more recent themes TwoDecadesof„Sciencometrics“–Aninterdisciplinaryfieldrepresendedbyitsleadingjournal*
Category 1980 1989 1997
1 Bibliometric Theory, Mathematical Models and Formalisation of Bibliometric Laws
1 6 3
2 Case Studies and empirical Papers 5 21 35
3 Methodological Papers including applications 6 24 25
4 Indicator Engineering and Data Presentation 2 6 1
5 Sociological Approach to Bibliometrics, Sociology of Science
5 9 6
6 Science Policy, Science Management and General or Technical Issues
12 1 5
Total 31 67 75
*Fromanar;cleinthe„Scientometrics“Journal.Vol50,No.2(2001)301‐312:h1p://www.steunpuntoos.be/WG_Papers/Scientometrics_50_3_301.pdf
Table:Classifica-onofPaperspublishedinthejournal„Scientometrics“bycategories
Scientometrics, Research Information Systems
Scientometrics – more recent themes GENERALWORKSONINFORMETRICS
Structureofthefieldandrela;onstootherfields Historyofbibliometrics Analysisofacknowledgements
THEORY Informetriclaws distribu;onsandconcentra;on Timeandgrowth Otherworksontheory
METHODSANDTECHNIQUES• Mappingandvisualiza;on• Textanddataminingandotherlinguis;ctechniques• Networkanalysis• Classifica;on,Othermethods
CITATIONANALYSIS• Characterizingpublica;onsandfields• Theore;calandmethodologicalaspects• Self‐cita;on• Ego‐centeredcita;onstudies• Qualityassessment• Errorsincita;onanalysis• OtherCita;onanalysis
INDICATORS• H‐Index• Impactfactors• Otherbibliometricindicators
WEBOMETRICS• WebImpactFactors• Measuresandmethodologicalissues• The‘academic’web• Commercialsites• Linkingmo;va;onsand/orcontentanalysis• Journalsandwebcita;ons
JOURNALS• The‘impactfactor’debate• Journalquality• Journalcoverageandstructure• Journalprofiles• Non‐Englishjournalsandinterna;onaliza;on• Journaleditorsandeditorialboards
OPENACCESSANDELECTRONICPUBLICATIONS• StudiesonOpenaccessand/orElectronicpublica;ons• DebateonOpenaccessand/orElectronicpublica;ons
PRODUCTIVITYANDPUBLICATIONS• Countrylevelstudies• Fieldspecificstudies• Mediacoverageofscience• Interdiscplinarity• Genderand/orotherSociologicalissues• OtherstudiesonProduc;vity
COLLABORATION• Studiesinspecificfields• Studiesonna;onal,grouporauthorlevel
RESEARCHPOLICY• Researchevalua;on• Universityrankings• ScientometricsindicatorsinS&Tpolicy• Otherstudiesand/ordebateonResearchpolicy
PATENTANALYSIS• Patentcita;onsandscienceandtechnologylinks• Otherpatentindicators
BIBLIOGRAPHICDATABASES• comparisonsbetweendatabases,coverage,retrievaltechniquesanddataisola;on
ISSIInterna8onalConferenceforScientometricsandInformetrics(2009):h1p://www.issi2009.org/
Topicsofinterestinclude,butarenotlimitedto:
Scientometrics, Research Information Systems
Scientometrics – The Journal Impact Factor
• Ameasureofcita;onstoscienceandsocialsciencejournals• Appliedtojournalsonly(Garfield),notindividualar8cles• InchargeofISI(nowpartofThomsonReuters)
Calcula8on(h1p://en.wikipedia.org/wiki/Impact_factor#Calcula;on):– two‐yearperiod– Averagenumberofcita;onsinagivenyeartothosepapersinajournal
thatwerepublishedduringthetwoprecedingyears
Example:2003impactfactorofajournalwouldbecalculatedasfollows:
• The2003impactfactoriseffec;velypublishedin2004,becauseitcannotbecalculatedun;lallofthe2003publica;onshadbeenreceived.
A=numberof;mesar;clespublishedin2001‐2002werecitedinindexedjournalsduring2003B=numberof„citableitems“(usuallyar;cles,reviews,proceedingsornotes,noteditorialsandle1ers‐to‐the‐Editor)publishedin2001‐2002
2003ImpactFactor=A/B
Scientometrics, Research Information Systems
Scientometrics – Problems with the Impact Factor
• originallyintendedasanobjec;vemeasureofthereputabilityofajournal(Garfield),itisnowbeingincreasinglyappliedtomeasuretheproduc;vityofscien;sts.
• ouenmisusedtopredicttheimportanceofindividualpublica;ons
• notrelevantforliterature,wherethemostimportantpublica;onsarebooksci;ngotherbooks‐>therefore,ThomsonScien;ficdoesnotpublishaJournalCita;onReport(JCR)forthehumani;es
• notrelevantformanyareasofcomputerscience,wherethemajorityoftheimportantpublica;onsappearinrefereedconferenceproceedingsandciteotherconferenceproceedings
• cannotcorrectlybetheonlythingtobeconsideredbylibrariesinselec;ngjournalseventhoughinprac;cetheyareappliedthisway
• comparisonofIFsbetweendifferentfieldsisinvalid
• generally,i.e.,medicaljournalshavehigherimpactfactorsthanmathema;caljournalsandengineeringjournals.
• ...
Scientometrics, Research Information Systems
Scientometrics – Problems with the Impact Factor
• journalsmaychangeeditorialpolicies
• journalsmaysome;mespublishalargerpercentageofreviewar;cles
• whilemanyresearchar;clesremainuncitedauer3years,nearlyallreviewar;clesreceiveatleastonecita;on
• journalsmaychangethefrac;onof"citableitems"comparedtofront‐ma1erinthedenominatoroftheIFequa;on
• thetypesofar;clesconsidered"citable"islargelyama1erofnego;a;onbetweenjournalsandThomsonScien;fic
‐>i.e.editorialsinajournaldonotcountaspublica;ons‐>wheneditorialscitepublishedar;cles,theyincreasethecita;oncountforar;cles‐>"Le1erstotheeditor"mayrefertoeitherclass.
• ...
Scientometrics, Research Information Systems
Scientometrics – The Impact Factor Validity
• TheIFcouldnotbereproducedinanindependentaudit
• TheIFreferstotheaveragenumberofcita;onsperpaper
• Thetemporalwindowforcita;onsisshort
• ThomsonScien;ficdoesnotcontainmanyinterna;onaljournalsorothertypesofpublica;ons(books,...)
• ThomsonScien;ficcontainsonlyafewpublica;onsfromlanguagesotherthanEnglish
• manyhighqualityjournalsintheappliedaspectsofsomesubjectsarenotincluded(suchasmarke;ngcommunica;ons,publicrela;onsandpromo;onmanagement;notpeer‐reviewedtechnicalmagazines)
• conferenceproceedingspublica;onsarenotindexed,includingconferences,workshopsandsymposia.
• …
Seealso:h1p://en.wikipedia.org/wiki/Impact_factor
Scientometrics, Research Information Systems
Scientometrics – Some Links
• Journal„Scientometrics“Scientometricsisconcernedwiththequan;ta;vefeaturesandcharacteris;csofscience.Emphasisisplacedoninves;ga;onsinwhichthedevelopmentandmechanismofsciencearestudiedbysta;s;calmathema;calmethods.h1p://www.springerlink.com/content/101080/
• ISIWebofKnowledge:h1p://www.isiweboxnowledge.com/
• STIIndicatorsfortheEuropeanResearchArea(STI‐Area):h1p://cordis.europa.eu/indicators/
• OECDDirectorateforScience,TechnologyandIndustry:h1p://www.oecd.org/department/0,3355,en_2649_33703_1_1_1_1_1,00.html
• Interna8onalConferenceonScienceandTechnologyIndicators(2008):h1p://systemsresearch.ac.at/s;‐conference/
Scientometrics, Research Information Systems
Scientometrics – Research Information Systems
ScientometricStudiesdepend
– onaninforma;onsystem
– onthedatainthesystem
Scientometrics, Research Information Systems
Research Information Systems CurrentResearchInforma8onSystems(CRIS)bringtogethertheinforma8onthatunderpinstheResearchforQualityResearchManagement(hnp://www.euroCRIS.org/)
• ForResearchers:– easyaccesstorelevantinforma;onandassociatedsouware,– processorpower,storagesystemsand‐wherenecessary‐detectors
tocollectmoredatatoovercomeincompleteorinconsistentinforma;on
• ForresearchManagersandAdministrators:– easymeasurementandanalysisofresearchac;vity– easyaccesstocompara;veinforma;on
• ForResearchCouncils:– op;misa;onofthefundingprocess
• Forentrepreneursandtechnologytransferorganisa8ons:– easyretrievalofnovelideasandtechnologyinaknowledge‐assistedenvironment– easyiden;fica;onofcompe;torsandpreviouslydonesimilarresearch
• Forthemediaandpublic:– easyaccesstoinforma;on,souwareandcomputerpowertoalloweasily‐assimilated
presenta;onofresearchresultsinappropriatecontexts.
Scientometrics, Research Information Systems
Research Information
Data/Metadata or Information about:
• Scientists • Project Managers • Ongoing and Completed Projects • Research Departments • Funding Organisations and Programmes • Research Results • Publications • Equipment • …
• their timely Relationships (Semantics)
Scientometrics, Research Information Systems
Information Systems - Modelling
– A Concept about (Research) Entities and their Relationships Specification (Conceptual Level)
– A Description of (Research) Entities and their Relationships Model (Logical Level)
– A Formalization of (Research) Entities and their Relationships Database Scripts (Physical Level)
SQL Script ----------------------- CREATE Table Person CREATE Table Project CREATE Table OrgUnit
Scientometrics, Research Information Systems
Modeling: Example Data Model (CERIF)*
Equipment
ProjectProject OrganisationOrganisation
Service
FundingProgramme
Patent
Skills
CV
Product
Event
PersonPerson
Classification(Semantics)Classification(Semantics)
Publication
CommonEuropeanResearchInforma8onFormat
*h1p://www.eurocris.org/cerif/
Scientometrics, Research Information Systems
What is CERIF?
CommonEuropeanResearchInforma;onFormat
(1) datamodel
(2) allowsfora(metadata)representa;onof– researchen;;es– theirac;vi;es/interconnec;ons(research)– theiroutput(results)
(3) offershighflexibilitywith(seman8c)rela;onships
(4) enablesqualitymaintenance,archiving,accessandinterchangeofresearchinforma;on
(5) supportsknowledgetransfertodecisionmakers,forresearchevalua;on,researchmanagers,strategists,researchers,editors,thegeneralpublic
(6) enablesastandardizedsetupofresearchinforma;onsystems
Scientometrics, Research Information Systems
Metadata
„Metadata is structured data which describes the characteristics of a resource.”
An Introduction to Metadata, by Chris Taylor, University of Queensland
“Metadata is sometimes defined literally as 'data about data,' but the term is normally understood to mean structured data about resources that can be used to help support a wide range of operations. These might include, for example, resource description and discovery, the management of information resources and their long-term preservation.”
Metadata in a Nutshell, by Michael Day, UKOLN
Scientometrics, Research Information Systems
Examples of Metadata? Book: Title: The Hitchhiker‘s Guide to the Galaxy Date of Publication: 1979
Game Cover Image: The Hitchhiker‘s Guide to the Galaxy Source: http://egotron.com/ Retrieved: May 30, 2008
Radio Series: Title: The Hitchhiker‘s Guide to the Galaxy Description: is a science fiction comedy series created by Douglas Adams. Originally a radio comedy broadcast on BBC Radio 4 in 1978, […] Source: Wikipedia Date of Query: May 30, 2008
Series of five Books: Title: The Hitchhiker‘s Guide to the Galaxy. Between: 1979 - 1982
TV Series: Title: The Hitchhiker‘s Guide to the Galaxy Screened: 1981
Computer Game: Title: The Hitchhiker‘s Guide to the Galaxy Released: 1984
Comic Book Adaptions: Title: The Hitchhiker‘s Guide to the Galaxy Between: 1993 – 1996
Links: http://www.bbc.co.uk/cult/hitchhikers/ HTML-Title: Cult – The Hitchhiker‘s Guide to the Galaxy http://en.wikipedia.org/wiki/The_Hitchhiker's_Guide_to_the_Galaxy HTML-Title: The Hitchhiker's Guide to the Galaxy
Data about Dat
a
Structure: • Type of Resource • Title • Description • Source • Date • Author, Creator, …
Scientometrics, Research Information Systems
Examples of Metadata
CitationTypes Type:
Description:
Publication URI: Type: Title: PartOf: PublDate:
Article Requests 2007 Journal X = 4 Journal Y = 0 Journal Z = 15
Ends in 2010 Journals: Y, Z
Organisation URI:
Name: Abbreviation: Publications:
Academic Staff:
Journal Publications 2007 Institute A = 4 Institute B = 10 Institute C = 9
Organisation URI: Name: hasAccess: EndOfAccess ContactPerson:
Journal Subscriptions Journal X = 1990 - 2000 Journal Y = 2005 - 2010 Journal Z = 2001 - 2010
PhD Students 2008 Computer Science = 200
Physics = 50 Social Sciences = 9
First Author / No of Papers Person H = 10/35 Person I = 4/12 Person J = 1/10
Citations in 2007 Paper M (publish 2007) = 20 Paper N (publish 2004) = 100 Paper O (publish 2001) = 0
DataMetadata
Scientometrics, Research Information Systems
What is Formal Metadata?
FormalMetadata=Metadataformalized
• Typed‐>BasedonModelEn;tyTypes
• Structured‐>FollowingaFormalModelStructure
Scientometrics, Research Information Systems
Metadata – Formal Metadata (CERIF Semantics)
Information Systems
Computer Science
Library Science
Artificial Intelligence
Computational Linguistics
Philosophy
Mathematics
Information Science
Physics
Subject Headings
Controlled
Vocabulary
Scientometrics, Research Information Systems
Metadata – Formal Metadata (CERIF Semantics)
is author (numbered)
of
is author
of
is reviewer
of
is author (percentage)
of
is editor (numbered)
of
is editor
of
is subject
of
is translator
of
is publisher
of
Person_Publication Roles
Controlled
Vocabulary
Scientometrics, Research Information Systems
Metadata – Formal Metadata (CERIF Semantics)
Book Review
Book Chapter
Book Chapter Abstract
Inbook
Book Chapter Review
Anthology Monograph Reference Book
Textbook
Encyclopedia
Otherbook
Journal
Journal Article
Journal Article Abstract
Journal Article Review
Conference Proceedings Article
Letter to Editor
PhD Thesis
Doctoral Thesis
Poster Presentation
Book Manual
Conference Proceedings Letter
Report
Short Communication
Commentary
Annotation
News Clipping
Publication Types
Controlled
Vocabulary
Scientometrics, Research Information Systems
Scientometrics – Some Examples hnp://www.ist‐world.org/
Aim: investigate the thematic range of SSA projects in FP6
Thematic Areas (Blue Clouds): SEMANTIC HEALTH LEGAL CHANGING ROADMAP SOFTWARE
Projects (Red Dots) Linked with Full Record in Repository
Scientometrics, Research Information Systems
Scientometrics – Some Examples hnp://www.ist‐world.org/
Aim: investigate the thematic range of SSA projects in FP6
Goals
Themes
Scientometrics, Research Information Systems
Scientometrics – Some Examples hnp://www.ist‐world.org/
Aim: investigate the collaboration of SSA partners in FP6
Number of joint partners
Project
Scientometrics, Research Information Systems
Research Information System - LT World
h1p://www.lt‐world.org/
Scientometrics, Research Information Systems
Research Information System - LT World
h1p://www.lt‐world.org/