peer review - sigma xi final

8/3/2019 Peer Review - Sigma Xi Final

http://slidepdf.com/reader/full/peer-review-sigma-xi-final 1/25

Peer Review Ethics: A Tale of TwoMindsets

Presented by: Stephen D. RappaportPresented to: Sigma Xi, 2011 Annual Meeting

Ethics Symposium, Interrelationship of Science,Culture, Religion and Ethics

Authors: Stephen D. Rappaport, QI; Janna

Kamanskaia, Queens College; Howard Moskowitz, QI



Questioning Institute: Sigma Xi Annual Meeting, November 12, 2011

Background

Sigma Xi 2011theme: “Year of Ethics”

Asked Dr.Moskowitz, 2010Chubb AwardWinner, to explorepeer review ethicsusing the science of

mind genomics




Mind Genomics in Brief

Goal: understand everyday experience through scienceto understand how perceptions organize our lives, howour values drive responses, and how people differ fromeach other

Individuals hold mindsets towards every entity

Every entity usually has two or more mindsetsassociated with it

Mindsets are discoverable through experimentation

Understanding the different mindsets provides us with

the ability to take actions based on them




Mind Genomics in Brief (Cont’d)

Experiments utilize a set of elements, presented ingroups (vignettes), and fully randomized

Vignettes evoke a mental picture that respondents rate

Respondents rate the vignettes on two scales: ethics andemotion

Later asked classification questions Analytic routines:

transform scalar values to binary (ethical, not-ethical)

the impact value of each element,

the emotion linked with each element,

a segmentation that reveals the mindsets

a segmentation wizard that assigns people to mindsets



DEVELOPED ELEMENTS FOR VIGNETTES

Sigma Xi

members

ANALYZED DATA

DATACOLLECTION SURVEY

STUDY POPULATION: SIGMA Xi Members

Total

Sample

Seg 1 Self

Driven Online

Banking

Seekers

Seg2

Technology/

High Security

Seekers

Seg3

Collaborative

OnlineSeekers

Seg4 Personal

Touch with

Technology

B as e S iz e: ( 26 7) ( 10 5) ( 50 ) ( 59 ) ( 53 )

Const ant : 31 34 28 31 26

OC1 Connect online in 'realtime' witha customerrep via instant

messaging, voiceoverIP or videoconferencing viayour

computer 0 2 2 5 -13

OC3 Fasterl oanapplicationprocess…workin real timeonline with a

l oan offi cer 0 0 - 8 1 2 -8

OC4 Our bank's customerservicereps will help you browseand use

ou ron li ne ban ki ng se rv ic es - 1 0 - 6 1 0 - 10OC2 Use our onlinetoolto find and schedule at your convenience an

online working session with anexpert such as investment broker,

insuranceagent, and/or loan officer -3 1 -11 6 -12

ON3 We willanswer all yourrequestsin'real time'by email, instant or

text messaging 1 7 - 11 3 -1

ON4 We offer 'On demand' status reportsfor services requests (e.g.,

l o an a pp l ic a ti o n) d e li v er e d t o yo u v i ae - ma i l, t e xt o r i ns t an t 1 6 - 4 - 3 0

ON2 No more papermail... Wewillsend youstatementsand imagesof

t ra ns ac ti on ss ec ur el y b ye ma il - 2 5 - 17 - 5 2ON1 W eallow you to paybills securely using your mobiledevices(cell

p ho ne , P DA , B la ck be rr y, e tc .) - 4 2 - 13 - 9 - 2

BR3 W eoffer abank-issuedsmart cardso wecan recognizeyou

e nt e ri ng t he b ra nc ha nd p ro ce ss y ou r n ee ds f as t er 4 2 6 - 3 1 3

BR4 Choose asecureeyeor fingersecurity scan toidentify youi mme di at el y i n- br an ch a nd a t A TM 4 3 1 0 - 1 3

BR2 W ehavethemost securebiometric system that identifiesyou as

y o u e nt e r th e b r an c hs o w e ca n p ro c es s y ou r n ee ds f a st e r 2 - 1 8 - 5 6

BR1 We will recognizeourcustomer'smobile phonesignalwhen

entering abranchso wecanr ecommend appropriate bank

p ro du ct s, p ro mo ti on sa nd s pe ci al s er vi ce s - 4 - 3 - 6 - 11 2

OnlineCollaborative

OnlineOther

In-Branch R ecognition

Nom

ore paper mail – we will send you copies ofs tatements by secure e-mail

Securely manage your accountby PDA, Internet of automatedtelephone

Our banks customer services reps will help browse & use our on-line services

Manage all your banking needs witha state of the artkiosk andbe confident

thatlive help is available ifyou need it

Nom

ore paper mail – we will send you copies ofs tatements by secure e-mail

Securely manage your accountby PDA, Internet of automatedtelephone

Our banks customer services reps will help browse & use our on-line services

Manage all your banking needs witha state of the artkiosk andbe confident

thatlive help is available ifyou need it

MINDSETS SEGMENTATION WIZARDINTERESTS/EMOTIONS

Recruited by Dr.

Crosby

August 29 –

Sept 5, 2011

368 completes




Elements for the Vignettes




Respondent Orientation




Stimulus: 48 VignettesFirst Rated for Ethical Level




Vignette then Rated for a SingleEmotion



11

1. Scientists expect journals to be ethical.Know what promotes/detracts.

Scientific Transparency

Lack of Integrity




12

2. Emotions Correlate with EthicalPractices




Different Scientists …Different Mindsets?




3. 2 Different MindsetsScientific Advance, Procedural

“Seems there is always thosethat want to go forward at thecost of convention and thosethat would rather stick tobetween the lines.” -- Prof. T. Calquhoun, U. Florida

Similar inconsider-ing a

journalethicalBUT havedifferentfocii




Mindset Highlights

ProcedureReporting, Editorial Process

Most Positive

Exp’l method clearly stated

Key concepts fully cited

Published articles serve readerinterests

Referree appt. process is transparent

Most Negative

Popular theories/methods pushed

Non-conforming results rejected

Friends receive preference Referees reject findings that contradict

their beliefs

Scientific AdvanceReplication, Error Correction,

Discoveries

Most Positive

Errors widely publicized

Replications given regular space

Formal appeals process resolvesdisputes

New discoveries published

Most Negative

Friends receive preference

Throw single data points away

Alter figures Copying without citation




4. Mindsets Shift as Scientists Mature

0

20

40

60

80

Total

Sample

18-29 30-44 45-64 65+

Age Group

P

e

r c

e

n

t

Advance

Procedure




5. As Careers Evolve … EthicalInterests Shift

18-29

Fair Shake

Objective

oversight

Replication

studies

Transparent

referee ap-

pointment

Qualified

referees

30-44

Build Career

Concepts fully

cited

Reader interest

Alternatives for

rejects

Transparent

referee ap-

pointment

45-64

Cement Authority

Exp’l method clear.

Int’l property

safeguards

Concepts fully cited

65+

Integrity

Data with

integrity and

replicable

Formal appealsand dispute

resolution




Mindsets are Easily TypedA “Scratch Test”

http://mjiweb.com/mjitt/PeerReview/index.htm

3 Questions (determined by Discriminant FunctionAnalysis)

Identifies mindset of individual

Specifies positive and negative elements thatappeal or “turn off”




Mindset TypingA “Scratch Test”

http://mjiweb.com/mjitt/PeerReview/index.htm




Questions Raised by Mindsets forScientific Publishing

Is one of the mindsets “better” for science?

Should submission guidelines be tailored toeach mindset?

Should journals determine and match the

mindsets and ages of editors, reviewers andauthors to ensure fairness and opportunity?

Are young scientists and engineers led todemonstrate “correctness” over researchinginteresting questions?

What other scientific concerns would benefitfrom knowing mindsets?




Further Research

Scientists mindsets toward dealing withethical lapses and breaches

Public’s mindsets towards scientific

ethics




Thank You!

For further information about this study: Stephen D. Rappaport, Howard R.

Moskowitz

Email:

[email protected]

[email protected]

Data available at:www.questioninginstitute.com, click on

“ethics”

Full study report will be available at:www.questioninginstitute.com




Appendix



25

Publication Procedure:Concern with reporting and editorialprocess



26

Scientific Advance:Replication, Error Correction, Discoveries,Integrity




Definitions

Additive Constant (segmentation)

The probability that a respondent will assign theconcept “ethical journal” without any elements

Impact Value (elements)

When positive, the conditional probability of peopleswitching from calling a journal “non-ethical” tocalling a journal “ethical,” and vice versa, when thatelement is present in a vignette

Strength of Linkage (for emotions)

When a specific element appears in a vignette, theprobability that the entire vignette is assigned aspecific emotion

peer review - sigma xi final

Documents