what to choose: internal reporting guidelines or external reporting guidelines? a step closer to...
TRANSCRIPT
What to choose: internal reporting guidelines or external reporting guidelines?
A step closer to answering this dilemma
March 2012 Class 8
Introdução à Medicina II
Class 8 2
SUMMARY
• Introduction
• Justification
• Research question
• Aims
• Methods
• Some results
• Expected results
• References
What to choose: internal reporting guidelines or external reporting guidelines?A step closer to answering this dilemma
March 2012
Class 8 3
INTRODUCTION
March 2012
SCIENTIFIC KNOWLED
GE DIVULGATI
ON
Scientific journals
Books
Conferences
Governmental reports
Technical reports
Flyers
Online versions
What to choose: internal reporting guidelines or external reporting guidelines?A step closer to answering this dilemma
Class 8 4
INTRODUCTION
March 2012
Scientific articles Scientific journals
First scientific journal First medical journal
Philosophical Transactions of the Royal Society1665
New England Journal of Medicine1812
published in
What to choose: internal reporting guidelines or external reporting guidelines?A step closer to answering this dilemma
Class 8 5
INTRODUCTION
March 2012
Scientific articlesContain…
• Motivation of the author• Experimental design and execution• Meaning of the results• Conclusions and recommendations
Require…• Clarity• Concision• Organization• Objectivity
• Better comprehension• More effective way of using its results
To accomplish
What to choose: internal reporting guidelines or external reporting guidelines?A step closer to answering this dilemma
Class 8 6
INTRODUCTION
March 2012
Impact of scientific journals
Impact Factor (IF) Average number of times an article published in a given journal was cited in the last two years
Comparison between different scientific areas can induce biased conclusions
Journal Citation Report ISI Web of Knowledge
What to choose: internal reporting guidelines or external reporting guidelines?A step closer to answering this dilemma
Impact ≠ Quality
Class 8 7
INTRODUCTION
March 2012
Impact of scientific articles
Number of citations
Possible biases:• Size of the articles• IF of the journal in which they are published
ISI Web of Knowledge
Presented in the end of the academic work, bibliographies or specific indexes
What to choose: internal reporting guidelines or external reporting guidelines?A step closer to answering this dilemma
Impact ≠ Quality
Class 8 8
INTRODUCTION
March 2012
GuidelinesInformation for the authors on how they must write their manuscript
Scientific Journals
Not presentation of guidelines
Presentation of guidelines
(recommendation or obligation)
Editing Guidelines
Reporting Guidelines
External
Uniform RequirementsSTREGA SQUIRE STROBE
CONSORT STARD PRISMAGNOSISTRENDORIONCOREQ
QUORUM REMARKMOOSE
Internal
What to choose: internal reporting guidelines or external reporting guidelines?A step closer to answering this dilemma
Class 8 9
INTRODUCTION
March 2012
GuidelinesUniform Requirementsfor Manuscripts Submitted to Biomedical Journals
General Reporting Guidelines
Vancouver Group(Vancouver, British Columbia, 1978)
International Committee of Medical Journal Editors (ICMJE)
First statements: 1979Last update: 2010
What to choose: internal reporting guidelines or external reporting guidelines?A step closer to answering this dilemma
INTRODUCTION
March 2012 10Class 8
GuidelinesRefering to a particular type of study and to other specific aspects of science publication
What to choose: internal reporting guidelines or external reporting guidelines?A step closer to answering this dilemma
GNOSIS Guidelines for neuro-oncology: Standards for investigational studies
CONSORT Consolidated Standards of Reporting Trials
COREQ Consolidated criteria for reporting qualitative research
MOOSE Meta-analysis of Observational Studies in Epidemiology
ORION Outbreak Reports and Intervention Studies Of Nosocomial infection
PRISMA Preferred Reporting Items for Systematic Reviews and Meta-Analyses
QUORUM Quality of Reporting of Meta-analyses of Randomized Controlled Trials
REMARK REporting recommendations for tumour MARKer prognostic studies
SQUIRE Standards for Quality Improvement Reporting Excellence
STARD Standards for the Reporting of Diagnostic Accuracy Studies
STREGA Strengthening the Reporting of Genetic Association studies
STROBE Strengthening the Reporting of Observational studies in Epidemiology
TREND Transparent Reporting of Evaluations with Nonrandomized Designs
JUSTIFICATION
December 2011 11Class 8
Scientific articles - Relevance for doctors:
What to choose: internal reporting guidelines or external reporting guidelines?A step closer to answering this dilemma
Medical care is improved by new discoveries and studies that promote a better life perspective for patients.
Breakthroughs are published in scientific articles.
In order to achieve a better treatment for patients and a good management of resources it is imperative to divulgate the knowledge
in the clearest way possible Scientific articles highly effective.
Class 8 12
Depends on…• Sientific content• Way that it is written
March 2012
JUSTIFICATION
The quality of a scientific articleInfluences…
• Interest of scientific community• Diffusion and applicability of the results
PROBLEM:It is not known which type of reporting guidelines leads to a
better diffusion of the scientific breakthroughs.
What to choose: internal reporting guidelines or external reporting guidelines?A step closer to answering this dilemma
Highest impact of the articles published
Class 8 13
RESEARCH QUESTION
March 2012
Is there any association between the use of internal reporting guidelines and/or external reporting guidelines and the impact of scientific articles published in Journals of General and Internal
Medicine?
What to choose: internal reporting guidelines or external reporting guidelines?A step closer to answering this dilemma
Class 8 14
AIMS
March 2012
Central aim:Evaluate the association between the use of internal or external reporting guidelines and the impact of scientific articles published in General and Internal Medicine Journals.
Specific aims:
• Determine the type of reporting guidelines recommended by each selected scientific journal of General and Internal Medicine.
• Measure the impact of different scientific papers published in 2008 in journals with reporting guidelines.
• Compare the impact of scientific papers published in journals that present internal reporting guidelines to the impact of the articles published in journals which recommend external reporting guidelines.
• Compare the advantages of the use of external reporting guidelines over the use of internal reporting guidelines.
What to choose: internal reporting guidelines or external reporting guidelines?A step closer to answering this dilemma
Class 8 15
METHODS
March 2012
What to choose: internal reporting guidelines or external reporting guidelines?A step closer to answering this dilemma
Class 8 16
METHODS
March 2012
Type of study:
• Observational study
• Transversal study
• Analytic study
What to choose: internal reporting guidelines or external reporting guidelines?A step closer to answering this dilemma
Class 8 17
METHODS
March 2012
What to choose: internal reporting guidelines or external reporting guidelines?A step closer to answering this dilemma
Tasks Class 8 Class 21
Colect list of journals of General and Internal Medicine X X
Apply exclusion/inclusion criteria X (distribution)
X (collection)
Colect Impact Factors from 2008, 2009 and 2010 X (distribution)
X (collection)
Analyse the reporting guidelines X (distribution)
X (collection)
Colect articles from 2008 and their number of citations X
Analyse journals by group X
Analyse 6 articles from 2008 for each group X
Calculate impact of articles from 2008 and make statistical analyses X
Class 8 18March 2012
Search in ISI Web of Knowledge for journals of General and Internal Medicine.1
http:// www.isiknowledge.com
METHODS
What to choose: internal reporting guidelines or external reporting guidelines?A step closer to answering this dilemma
Class 8 19March 2012
From all the journals found, distribute its primary analysis by the students of two classes to apply some criteria and collect their Impact Factor from 2008, 2009 and 2010.2
Inclusion Criteria • Journals which have an available web site.
Exclusion Criteria • Websites not written in Portuguese, English or Spanish.
METHODSWhat to choose: internal reporting guidelines or external reporting guidelines?A step closer to answering this dilemma
March 2012 20Class 8
From all the journals found, distribute its primary analysis by the students of two classes to apply some criteria and collect their Impact Factor from 2008, 2009 and 2010.2
METHODS
What to choose: internal reporting guidelines or external reporting guidelines?A step closer to answering this dilemma
March 2012 21Class 8
Compare the analysis of the journals made by the two reviewers and select the journals for the study.3
METHODS
What to choose: internal reporting guidelines or external reporting guidelines?A step closer to answering this dilemma
• Some statistic analysis is done to clarify the motives of exclusion of some journals and to verify how many journals are included in the study.
Class 8 22March 2012
From the included journals, select those with reporting guidelines and verify its type.4
• Go to the website of the selected journals• Read the section of the instructions for authors• Verify if any guidelines are presented and analyse its type• Select journals that present some type of reporting guidelines
METHODS
What to choose: internal reporting guidelines or external reporting guidelines?A step closer to answering this dilemma
Class 8 23March 2012
From the included journals, select those with reporting guidelines and verify its type.4
Until this point, most methods are commom to both of the classes, so there is a division of the tasks.
• Class 8 is responsible for doing the distribution of the journals between the two classes and for preparing the database.
METHODS
What to choose: internal reporting guidelines or external reporting guidelines?A step closer to answering this dilemma
Class 8 24March 2012
Search for articles of the selected journals which were published in 2008.5
• This information is collected on ISI Web of Knowledge
METHODS
What to choose: internal reporting guidelines or external reporting guidelines?A step closer to answering this dilemma
Class 8 25March 2012
Export information about selected articles to SPSS.6
• Title of the article• Authors• Number of citations• Journal in which it was published
METHODS
What to choose: internal reporting guidelines or external reporting guidelines?A step closer to answering this dilemma
Class 8 26March 2012
Calculate the impact for each article.7
2)2010()2009( IFIF
CNImpact of each article
CN – Citation NumberIF – Impact Factor of the journal
METHODS
What to choose: internal reporting guidelines or external reporting guidelines?A step closer to answering this dilemma
March 2012 27Class 8
Verify if there is an association between the impact of the articles and the type of reporting guidelines used by the journals.8
METHODS
What to choose: internal reporting guidelines or external reporting guidelines?A step closer to answering this dilemma
Separate articles into 3 groups:
Articles published in journals using internal reporting guidelines Articles published in journals using external reporting guidelines
(specifying what type) Articles published in journals using both types reporting guidelines
Calculate the mean impact of the articles for each group
Apply ANOVA to verify if there is evidence of diference between groups
Class 8 28
SOME RESULTS
March 2012
What to choose: internal reporting guidelines or external reporting guidelines?A step closer to answering this dilemma
There are 153 journals of General and Internal
Medicine.
Class 8 29
SOME RESULTS
March 2012
What to choose: internal reporting guidelines or external reporting guidelines?A step closer to answering this dilemma
Included
Excluded
Language
Not available website
134
19
4
15
Application of selection criteria to journals
SOME RESULTS
March 2012 30Class 8
What to choose: internal reporting guidelines or external reporting guidelines?A step closer to answering this dilemma
Divergences
Included
Excluded
23
16
7
Divergences between reviewers
SOME RESULTS
March 2012 31Class 8
What to choose: internal reporting guidelines or external reporting guidelines?A step closer to answering this dilemma
Average IF 2008 2009 2010 3 years
Included 1,021 1,142 1,303 1,120
Excluded 0,464 0,505 0,512 0,505
Language 0,506 0,491 0,474 0,487
Not available website 0,464 0,505 0,697 0,522
Median values of Impact Factor
Class 8 32
EXPECTED RESULTS
March 2012
There will be an association between the use of internal reporting guidelines and/or external reporting guidelines and the impact of scientific papers
HOWEVER…
Impact factor of the journal where the articles are published
Proper characteristics of the study presented in the article
…the differences between those impacts can also be due to:
What to choose: internal reporting guidelines or external reporting guidelines?A step closer to answering this dilemma
Class 8 33
EXPECTED RESULTS
March 2012
A guide to the creation (or maintenance) of reporting guidelines for scientific journals of General and Internal Medicine.
A motivation for further studies on this subject, involving other scientific areas
It is expected that our study serve as…
Generalization of the results
What to choose: internal reporting guidelines or external reporting guidelines?A step closer to answering this dilemma
Class 8 34
Jacinto T. Informação e conhecimento biomédico, pesquisa bibliográfica, bibliotecas digitais [Biomedical information and knowledge, bibliographic research, digital libraries] [slide]. Porto (Portugal): Faculdade de Medicina da Universidade do Porto (PT), Departamento de Ciências da Informação e da Decisão em Saúde; 2011. Portuguese, English.
Nahas FX, Ferreira LM. A arte de redigir um trabalho científico [periódico na Internet] 2005;20 Suppl. 2:17-8. Disponível em URL:
http://www.scielo.br/acb Nte AR, Awi DD. Writing a scientific paper: getting to the basics. Niger J. Med (2007) Jul-Sep;16(3):212-8. Jacinto T, Morais A, Fonseca JA. How to write a scientific paper - Searching and Managing Biomedical information. Rev Port
Pneumol. 2011;17:190-194. Samil LR. Writing and publication of a medical article. Vandenbroucke J P. STREGA, STROBE, STARD, SQUIRE, MOOSE, PRISMA, GNOSIS, TREND, ORION, COREQ, QUOROM, REMARK and
CONSORT: for whom does the guideline toll?. Clin Epidemiol. 2009;62:594-596. International Committee of Medical Journal Editors. ICMJE, International Committee of Medical Journal Editors [homepage on the
Internet]. [place unknown]: International Committee of Medical Journal Editors; 2009 [cited 2011 Nov 11]. Available from: http://www.icmje.org/
REFERENCES
March 2012
What to choose: internal reporting guidelines or external reporting guidelines?A step closer to answering this dilemma
Class 8 35
Rodrigues P. Artigos científicos, aspectos e orientações base [Scientific papers, guidelines and basic aspects] [slide]. Porto (Portugal): Faculdade de Medicina da Universidade do Porto (PT), Departamento de Ciências da Informação e da Decisão em Saúde; 2011. Portuguese, English.
CONSORT Group. CONSORT, TRANSPARENT REPORTING OF TRIALS [homepage on the Internet]. [place unknown]: Minervation;
[reviewed 2011 May 16; cited 2011 Nov 11]. Available from: http://www.consort-statement.org/ STROBE Group. STROBE Statement, Strengthening the Reporting of Observational studies in Epidemiology [homepage on the
Internet]. [Bern (Switzerland)]: ISPM – University of Bern; 2009 [cited 2011 Nov 11]. Available from: http://www.strobe-statement.org/
SQUIRE Group. SQUIRE, Standards for Quality Improvement Reporting Excellence [homepage on the Internet]. [Lebanon (NH)]:
[Publisher unknown]; [cited 2011 Dec 1]. Available from: http://squire-statement.org/ STARD Group. STARD Statement, STAndards for the Reporting of Diagnostic accuracy studies [homepage on the Internet].
[Amsterdam (The Netherlands)]: [Publisher unknown]; [reviewed 2008 Apr 22; cited 2011 Nov 11]. Available from: http://www.stard-statement.org/
Stefánsson E, Kivelä T. The ingredients of a good paper. Acta Ophthalmol. 2010; 88:619-621
REFERENCES
March 2012
What to choose: internal reporting guidelines or external reporting guidelines?A step closer to answering this dilemma