research evaluation contribution index h -indexbeta.garj.org/garjeti/pdf/2014/december/akira...

21
Global Advanced Research Journal of Engineering, Technology and Innovation (ISSN: 2315-5124) Vol. 3(9) pp. 217-234, December, 2014 Available online http://garj.org/garjeti/index.htm Copyright © 2014 Global Advanced Research Journals Full Length Research Paper Research Evaluation Contribution Index "h MC -Index" *1 Akira Otsuki and 2 Masayoshi Kawamura 1 Nihon University, Japan and 2 MK future software * Email: [email protected] Accepted 22 December 2014 We propose a new index to evaluate research contribution in a way that qualitatively improves on the h-index. Scientific contribution indexes, such as the h-, g-, A-, and R-indexes, typically assess contribution on the basis of published works, and particularly the number of times that those works are cited. As a result, well-experienced researchers and those who have many collaborators tend to be ranked more highly, independent of contribution. To address this, we suggest discounting cross-citations and then using the h-index formula on the modified citation counts. In this way, the index value will not be so heavily weighted against young researchers, who are likely to have fewer collaborators. This index is called the h MC -index because it is similar to the h-index but also considers mutual citations. We additionally propose a citation map whose structure is based on the h MC -index. Key words Bibliometrics, Research Evaluation Contribution Index, Big data engineering, Database INTRODUCTION A wide variety of indexes for rating research contributions by individuals have been suggested, including the h- and g-index. These indexes rely, however, on quantitative analysis of raw citation numbers of prior publications, and situations that seem qualitatively different, such as when a large number of papers are cited within a short time and when a small number of papers are cited over a long time, will yield the same index value if the number of citations is

Upload: others

Post on 08-Aug-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Research Evaluation Contribution Index h -Indexbeta.garj.org/garjeti/pdf/2014/December/Akira and...Journal Impact Factor is an evaluation index proposed for the evaluation of academic

Global Advanced Research Journal of Engineering, Technology and Innovation (ISSN: 2315-5124) Vol. 3(9) pp. 217-234, December, 2014

Available online http://garj.org/garjeti/index.htm

Copyright © 2014 Global Advanced Research Journals

Full Length Research Paper

Research Evaluation Contribution Index "hMC-Index" *1

Akira Otsuki and 2Masayoshi Kawamura

1Nihon University, Japan and

2MK future software

*Email: [email protected]

Accepted 22 December 2014

We propose a new index to evaluate research contribution in a way that qualitatively improves on the h-index.

Scientific contribution indexes, such as the h-, g-, A-, and R-indexes, typically assess contribution on the basis

of published works, and particularly the number of times that those works are cited. As a result,

well-experienced researchers and those who have many collaborators tend to be ranked more highly,

independent of contribution. To address this, we suggest discounting cross-citations and then using the h-index

formula on the modified citation counts. In this way, the index value will not be so heavily weighted against

young researchers, who are likely to have fewer collaborators. This index is called the hMC

-index because it is

similar to the h-index but also considers mutual citations. We additionally propose a citation map whose

structure is based on the hMC

-index.

Key words Bibliometrics, Research Evaluation Contribution Index, Big data engineering, Database

INTRODUCTION

A wide variety of indexes for rating research contributions

by individuals have been suggested, including the h- and

g-index. These indexes rely, however, on quantitative

analysis of raw citation numbers of prior publications, and

situations that seem qualitatively different, such as when a

large number of papers are cited within a short time and

when a small number of papers are cited over a long time,

will yield the same index value if the number of citations is

Page 2: Research Evaluation Contribution Index h -Indexbeta.garj.org/garjeti/pdf/2014/December/Akira and...Journal Impact Factor is an evaluation index proposed for the evaluation of academic

218 Glo. Adv. Res. J. Eng. Technol. Innov.

the same. It is difficult to calculate the exact importance of

each paper by using only conventional citation analysis.

Consequently, the use of conventional rating indexes may

result in high evaluations of papers that are seldom

referenced anymore but were frequently cited in the past.

We previously proposed the GV-index (Growing Degree

of Research Area and Variance Values-Index) to address

this problem (Otsuki & Kawamura 2013). The GV-index is

computed by principal component analysis to obtain a

value by the PageRank algorithm, which takes into

account growth in the research area and its variance.

However, the GV-index does not account for how

cross-citation can elevate citation counts. Because the h-,

g-, A-, and R-indexes are calculated from only the number

of citations, none of them account for cross-citations. This

means that the contributions of young researchers, who

have fewer collaborators, are likely to be undervalued in

the indexes.

This study proposes a new type of research contribution

ranking index that is an extension of the h-index and

considers mutual citation. We call this the hMC

-index

(h-index considering Mutual Citations). Specifically, this

proposed index is calculated by discounting

cross-citations and then calculating the h-index in the

usual way (detailed below). Accounting for mutual citations

will tend to correct the bias against new researchers, who

are likely to have fewer collaborators than established

researchers do. We also propose system to visualize a

researcher’s network by using the hMC

-index.

Related Studies

Impact Factor

Journal Impact Factor is an evaluation index proposed for

the evaluation of academic journal importance (Garfield,

1955a, 1995b; Garfield & Welljams-Dorof 1992). The

Impact Factor of a journal is calculated from the number of

citations within the last three years of papers published in

that journal. Journal Impact Factor was the first research

contribution rating index, but it is not intended to evaluate

individual researchers.

Research Contribution Evaluation Indexes

Impact Factor is an evaluation of a journal, not of an

individual researcher. Scientific contribution evaluation

indexes that are concerned with individuals are shown in

the next section.

h-index

The h-index (Hirsch, J.E. 2007; Bornmann, Lutz et al.

2007) was introduced by Hirsch. It is calculated by taking

into account the balance between the number of

publications and the number of citations per publication. A

researcher has an h-index of i if i of his or her published

papers have at least i citations and i is the maximum value

for which this is true. For example, an h-index of 7

indicates that an author has 7 publications that have each

received 7 citations or more, as shown in Table1.

Page 3: Research Evaluation Contribution Index h -Indexbeta.garj.org/garjeti/pdf/2014/December/Akira and...Journal Impact Factor is an evaluation index proposed for the evaluation of academic

Akira and Masayoshi, 219

Table1. h-index

Rank Paper Name Number of Citing Papers

1 Paper1 48

2 Paper2 21

3 Paper3 14

4 Paper4 13

5 Paper5 11

6 Paper6 10

h-index = 7 → 7 Paper7 9

8 Paper8 5

9 Paper9 4

10 Paper10 4

11 Paper11 2

12 Paper12 1

g-index

The g-index was proposed by Egghe (2006) as a

modification of the h-index. The g-index is calculated as

follows. First, Rank2 is calculated as shown in Table2. Next,

the cumulative number of papers citing the papers,

ordered by decreasing number of citations, is calculated.

Finally, the g-index is the largest number i of papers that

together have received i2 or more citations.

Table2. g-index

Rank Rank2 Paper Name Number of

Citing Papers Sum of

Citing Papers

1 1 Paper1 48 48

2 4 Paper2 21 69

3 9 Paper3 14 83

4 16 Paper4 13 96

5 25 Paper5 11 107

6 36 Paper6 10 117

7 49 Paper7 9 126

8 64 Paper8 5 131

9 81 Paper9 4 135 10 100 Paper10 4 139

g-index = 11 → 11 121 Paper11 2 141

12 144 Paper12 1 142

Page 4: Research Evaluation Contribution Index h -Indexbeta.garj.org/garjeti/pdf/2014/December/Akira and...Journal Impact Factor is an evaluation index proposed for the evaluation of academic

220 Glo. Adv. Res. J. Eng. Technol. Innov.

A-index

The A-index was proposed by Jin (2006) as a modification of the h-index. The A-index is the average number of citations

received by the h most cited papers, where h is the value of the h-index, as shown in Table3.

Table3. A-index

Rank Paper Name Number of Citing Papers

1 Paper1 48

2 Paper2 21

3 Paper3 14

4 Paper4 13

5 Paper5 11

6 Paper6 10

A-index

=(48+21+14+13+11+10+9)/7

=18

7 Paper7 9

8 Paper8 5

9 Paper9 4

10 Paper10 4

11 Paper11 2

12 Paper12 1

R-index

The R-index was proposed by Jin et al. (2007). The R-index is the square root of the h most cited papers, where h is the

h-index, as shown in Table4.

Page 5: Research Evaluation Contribution Index h -Indexbeta.garj.org/garjeti/pdf/2014/December/Akira and...Journal Impact Factor is an evaluation index proposed for the evaluation of academic

Akira and Masayoshi, 221

Table4. R-index

Rank Paper Name Number of Citing Papers

1 Paper1 48

2 Paper2 21

3 Paper3 14

4 Paper4 13

5 Paper5 11

6 Paper6 10

R-index

=√(48+21+14+13+11+10+9)

=11.22

7 Paper7 9

8 Paper8 5

9 Paper9 4

10 Paper10 4

11 Paper11 2

12 Paper12 1

AR-index

The AR-index (Jin et al. 2007) is an adaptation of the

R-index. The age-dependent R-index, denoted by AR, is

given by the following equation:

�� = ������� (1)

Where h is the h-index, citj is the number of times that

paper j was cited, aj is the number of years since

publication of article j, and articles are taken in order of

decreasing number of citations.

hg-index

The hg-index was proposed by Alonso (2010). The

hg-index is calculated as the geometric mean of the

h-index and the g-index.

ℎ� = �ℎ ∙ �(2)

IQp

Calculation of the IQp (Antonakis & Lalive 2008) is more

involved than that of the h-index or g-index. This index is

intended to be more sensitive and is computationally much

more complicated. The algorithm to calculate IQp is the

following.

��� = ������������� + �� ∗ � ∗ (����� + 1)2 ∗ ����� (3)

Here, citations are total numbers of citations of the

researcher, papers are the total numbers of papers, and

Page 6: Research Evaluation Contribution Index h -Indexbeta.garj.org/garjeti/pdf/2014/December/Akira and...Journal Impact Factor is an evaluation index proposed for the evaluation of academic

222 Glo. Adv. Res. J. Eng. Technol. Innov.

age is the number of years that the research has been

active.

Problems with existing indexes

The research contribution indexes shown in the section

above, like other conventional measures, depend on

published works, and because these indexes are

calculated from only the number of citations, these values

tend to be higher for researchers with more years of

experience and those who have a large number of

collaborators. This imparts a bias against young

researchers, who are likely to have fewer collaborators.

Concept

In order to solve the problem discussed in the previous

sections, we propose a new index calculated by

discounting for cross-citations after calculating the h-index.

In this way, we will be able to calculate a less biased

research evaluation index. We suggest this concept is

reasonable because the h-index is calculated using only

the number of citations receive

METHOD

The flow of the method to calculate the hMC

-index is shown here.

(1) Choose who to calculate the index for and a research area.

In this study, we used the Web of Science service (Thomson Reuters 2014) as the Journal database. The research area

is chosen from the list of research areas available in the service.

(2) Find the h-index of the chosen person and the papers used to achieve that index, which will be called the basis

papers (Table5).

Table5. Calculate the h-index.

Rank Paper Name Number of Citing Papers

1 Paper1 1,998

2 Paper2 133

3 Paper3 76

4 Paper4 48

5 Paper5 37

6 Paper6 34

7 Paper7 27

8 Paper8 26

9 Paper9 20

h-index = 10 → 10 Paper10 17

11 Paper11 6

12 Paper12 2

Page 7: Research Evaluation Contribution Index h -Indexbeta.garj.org/garjeti/pdf/2014/December/Akira and...Journal Impact Factor is an evaluation index proposed for the evaluation of academic

Akira and Masayoshi, 223

(3) Find cross-citations between the basis papers.

We show an example of cross-citations in Table6, where Paper2 cites Paper1 and Paper4. Cross-citations are identified by

using bibliographic information.

Table6. Find cross-citations between list members.

Citation Papers Papers

Paper1

Paper1, 4 ← Paper2

Paper3

Paper3 ← Paper4

Paper2, 4 ← Paper5

Paper1, 4 ← Paper6

Paper4, 5, 9, 10 ← Paper7

Paper1,2 ← Paper8

Paper1, 2, 3, 7, 10 ← Paper9

Paper2, 7, 10 ← Paper10

(4) As shown in Table7, weight the value of each basis paper to the multiplicative inverse of the number of

cross-citations plus one. For example, when the number of cross-citations for a paper is 2, the weighted value is 1/3.

Table7. Calculate the weighted values from the h-index basis papers.

Weighted Values Citing Papers

1.00 ← Paper1

0.33 1/3 ← Paper1, 4 ← Paper2

1.00 ← Paper3

0.50 1/2 ← Paper3 ← Paper4

0.33 1/3 ← Paper2, 4 ← Paper5

0.33 1/3 ← Paper1, 4 ← Paper6

0.20 1/5 ← Paper4, 5, 9, 10 ← Paper7

0.33 1/3 ← Paper1, 2 ← Paper8

0.17 1/6 ← Paper1, 2, 3, 7, 10 ← Paper9

0.25 1/4 ← Paper2, 7, 10 ← Paper10

Page 8: Research Evaluation Contribution Index h -Indexbeta.garj.org/garjeti/pdf/2014/December/Akira and...Journal Impact Factor is an evaluation index proposed for the evaluation of academic

224 Glo. Adv. Res. J. Eng. Technol. Innov.

(5) The hMC

-index is the sum of the weighted values, as shown in Table8.

Table8. Calculate the hMC

-index.

Weighted Values Citing Papers

1.00 ← Paper1

0.33 1/3 ← Paper1,4 ← Paper2

1.00 ← Paper3

0.50 1/2 ← Paper3 ← Paper4

Sum

0.33 1/3 ← Paper2,4 ← Paper5

0.33 1/3 ← Paper1,4 ← Paper6

0.20 1/5 ← Paper4,5,9,10 ← Paper7

0.33 1/3 ← Paper1,2 ← Paper8

0.17 1/6 ← Paper1,2,3,7,10 ← Paper9

0.25 1/4 ← Paper2,7,10 ← Paper10

hMC

-index → 4.44

Because there is no possibility of cross-citation with a list of fewer than two papers, the hMC

-index is exactly the h-index

when the h-index is 1. The steps of the algorithm can be formulized as (4).

ℎ#$ =� 1�% + 1�%� (4)

Here, h is the h-index; and ri is the number of basis papers that cite basis paper i. In (5) below, Pi is the cited papers (ci) of

the chosen author; and Paud is the list of papers sorted in descending order of number of citations received (including from

the chosen author). Paud is written as follows: P()* = +, (� ), ,.(�.),⋯ , ,0(�0)1for� ≥ �. ≥ ⋯ ≥ �0 . (5)

Visualization of the hMC

-index

We show an example of a network map based on the hMC

-index in Fig. 1. Each node of Fig. 1 represents an author, and

the hMC

-index of each author is displayed in the appropriate node, with the size of the node increasing with hMC

-index value.

Edges represent co-authoring. Grants information can be seen by selecting the edges. In Fig. 1, it can be seen that a paper

by authors A, B, and E is a study funded by grant A (shown by green arrow and text box), and the paper by authors C and

Page 9: Research Evaluation Contribution Index h -Indexbeta.garj.org/garjeti/pdf/2014/December/Akira and...Journal Impact Factor is an evaluation index proposed for the evaluation of academic

G is not funded by a grant (shown by black arrow and text box).

position of researchers in the research area. Furthermore,

successful publication.

Authors Paper Title

A, B, E Title 1

A, C, D Title 2

C, G Title 3

Fig1.

Akira and Masayosh

hown by black arrow and text box). This map provides a visual indication of the

s in the research area. Furthermore, is becomes easy to understand which grants are

Publication Year DOI Grant

2011 10.5121/〜 Grant A

2010 Grant B

2014 10.1109/〜 No Grant

Fig1. A network map based on the hMC

-index

Akira and Masayoshi, 225

This map provides a visual indication of the importance or

to understand which grants are resulting in

Grant

Grant A

Grant B

No Grant

Page 10: Research Evaluation Contribution Index h -Indexbeta.garj.org/garjeti/pdf/2014/December/Akira and...Journal Impact Factor is an evaluation index proposed for the evaluation of academic

226 Glo. Adv. Res. J. Eng. Technol. Innov.

Evaluation Experiment

Outline of Evaluation Experiment

Here, we evaluate the effectiveness of the hMC

-index by

compare results with the h-, g-, A-, and R-indexes.

Because the calculation method of the GV-index is

different from other indexes, it is not evaluated. First, we

fetched papers from the journal database system by using

the query "Chemistry, Multidisciplinary; Chemistry,

Physical; Nanoscience & Nanotechnology; Materials

Science, Multidisciplinary; Physics, Applied; Physics,

Condensed Matter" and a search period of 1960–2012,

resulting in about 24,700 papers. The included research

areas are areas of active study in Japan at present (Prime

Minister of Japan and His Cabinet 2013; Cabinet Office,

Government of Japan 2012; Japan Science and

Technology Agency 2013), this set of papers seems

appropriate. Table9 shows the top 10 papers, ranked by

number of citations received.

Table9. Ten most cited papers (with query “Chemistry, Multidisciplinary; Chemistry, Physical; Nanoscience &

Nanotechnology; Materials Science, Multidisciplinary; Physics, Applied; Physics, Condensed Matter”)

Number of Citations

Papers

1 2,675 Ma, WL; Yang, CY; Gong, X; et al. (2005). Thermally stable, efficient polymer solar cells with nanoscale control of the interpenetrating network morphology, ADVANCED FUNCTIONAL MATERIALS, Vol.15, No.10, pp.1617-1622.

2 2,633 Brabec, CJ; Sariciftci, NS; Hummelen, JC, (2001). Plastic solar cells, ADVANCED FUNCTIONAL MATERIALS, Vol.11, No.1, pp. 15-26.

3 1,998 Balandin, Alexander A.; Ghosh, Suchismita; Bao, Wenzhong; et al. (2008). Superior thermal conductivity of single-layer graphene, NANO LETTERS, Vol.8, No.3, pp.902-907.

4 1,836 Huang, MH; Wu, YY; Feick, H; et al. (2001). Catalytic growth of zinc oxide nanowires by vapor transport, ADVANCED MATERIALS, Vol.13, No.2, pp.113-116.

5 1,780 Stoller, Meryl D.; Park, Sungjin; Zhu, Yanwu; et al. (2008). Graphene-Based UltracapacitorsNANO LETTERS, Vol.8, No.10, pp.3498-3502.

6 1,780 Scharber, MC; Wuhlbacher, D; Koppe, M; et al. (2006). Design rules for donors in bulk-heterojunction solar cells - Towards 10 % energy-conversion efficiency, ADVANCED MATERIALS, Vol.18, No.6, pp.789-+.

7 1,572 Reina, Alfonso; Jia, Xiaoting; Ho, John; et al. (2009). Large Area, Few-Layer Graphene Films on Arbitrary Substrates by Chemical Vapor Deposition, NANO LETTERS, Vol.9, No.1, pp.30-35.

8 1559 Horowitz, G (1998). Organic field-effect transistors, ADVANCED MATERIALS, Vol.10, No.5, pp.365-377.

9 1,514 Derfus, AM; Chan, WCW; Bhatia, SN (2004). Probing the cytotoxicity of semiconductor quantum dots, NANO LETTERS, Vol.4, No.1, pp.11-18.

10 1,513 Vayssieres, L (2003). Growth of arrayed nanorods and nanowires of ZnO from aqueous solutions, ADVANCED MATERIALS, Vol.15, No.5, pp.464-466.

Page 11: Research Evaluation Contribution Index h -Indexbeta.garj.org/garjeti/pdf/2014/December/Akira and...Journal Impact Factor is an evaluation index proposed for the evaluation of academic

Akira and Masayoshi, 227

Result of Evaluation Experiment

Next, we selected the first author of the five most-cited papers for our experiment. We then obtained citation counts for the

papers written by these authors, as shown in Tables 10–14. Further, Tables 10–14 will show the calculation result values of

the h-, g-, A-, R-, and hMC

-indexes.

Table 10. List of papers by WL Ma and Ma’s hMC

-index, h-index, g-index, A-index, and R-index

Papers Information Compare of Index

Citation Name of the Papers hMC

-index h-inde

x

g-index A-inde

x

R-index

206 Ma, WL; Yang, CY; Gong, X; Lee, K; Heeger, AJ. (2005). Thermally stable, efficient polymer solar cells with nanoscale control of the interpenetrating network morphology, ADVANCED FUNCTIONAL MATERIALS, Vol.15, No.10, pp.1617-1622.

1

1.0

63 Kim, JY; Kim, SH; Lee, HH; Lee, K; Ma, WL; Gong, X; Heeger, AJ. (2006). New architecture for high-efficiency polymer photovoltaic cells using solution-based titanium oxide as an optical spacer,ADVANCED MATERIALS, Vol.18, No.5, pp.572-+.

4

2.0

23 Gong, X; Ma, WL; Ostrowski, JC; Bazan, GC; Moses, D; Heeger, AJ. (2004). White electrophosphorescence from semiconducting polymer blends,ADVANCED MATERIALS, Vol.16, No.7, pp.615-+.

9

3.0

17 Ma, WL; Iyer, PK; Gong, X; Liu, B; Moses, D; Bazan, GC; Heeger, AJ. (2005). Water/methanol-soluble conjugated copolymer as an electron-transport layer in polymer light-emitting diodesADVANCED MATERIALS, Vol.17, No.3, pp.274-+.

16

4.0

14 Ma, Wanli; Yang, Cuiying; Heeger, Alan J. (2007). Spatial Fourier-transform analysis of the morphology of bulk heterojunction materials used in "plastic" solar cells, ADVANCED MATERIALS, Vol.19, No.10, pp.1387-+.

25

5.0

13 Wu, Yue; Wadia, Cyrus; Ma, Wanli; Sadtler, Bryce; Alivisatos, A. Paul. (2008). Synthesis and photovoltaic application of copper(I) sulfide nanocrystals, NANO LETTERS, Vol.8, No.8, pp.2551-2555.

36

6.0

6 Ma, Wanli; Gopinathan, Ajay; Heeger, Alan J. (2007). Nanostructure of the interpenetrating networks in poly(3-hexylthiophene)/fullerene bulk heterojunction materials: Implications for charge transport, ADVANCED MATERIALS, Vol.19, No.21, pp.3656-+.

49

7.0

2 Gong, X; Ma, WL; Ostrowski, JC; Bechgaard, K; Bazan, GC; Heeger, AJ; Xiao, S; Moses, D. (2004). End-capping as a method for improving carrier injection in electrophosphorescent light-emitting diodes, ADVANCED FUNCTIONAL MATERIALS, Vol.14, No.4, pp.393-397.

64

8.0

0 Yuan, Jianyu; Zhai, Zhichun; Dong, Huilong; Li, Jing; Jiang, Zuoquan; Li, Youyong; Ma, Wanli. (2013). Efficient Polymer Solar Cells with a High Open Circuit Voltage of 1 Volt, ADVANCED FUNCTIONAL MATERIALS, Vol.23, No.7, pp.885-892.

5.00 6.00 81

9.00 56.00 18.33

Page 12: Research Evaluation Contribution Index h -Indexbeta.garj.org/garjeti/pdf/2014/December/Akira and...Journal Impact Factor is an evaluation index proposed for the evaluation of academic

228 Glo. Adv. Res. J. Eng. Technol. Innov.

Table 11. List of papers by CJ Brabec and Brabec’s hMC

-index, h-index, g-index, A-index, and R-index

Papers Information Compare of Index

Citation Name of the Papers hMC

-index h-index g-index A-index R-index

150 Brabec, CJ; Sariciftci, NS; Hummelen, JC, (2001). Plastic solar cells, ADVANCED FUNCTIONAL MATERIALS, Vol.11, No.1, pp. 15-26.

1

127 Scharber, MC; Wuhlbacher, D; Koppe, M; et al. (2006). Design rules for donors in bulk-heterojunction solar cells - Towards 10 % energy-conversion efficiencyADVANCED MATERIALS, Vol.18, No.6, pp.789-+.

4

81 Brabec, CJ; Cravino, A; Meissner, D; et al. (2001). Origin of the open circuit voltage of plastic solar cells, ADVANCED FUNCTIONAL MATERIALS, Vol.11, No.5, pp.374-380.

9

54 Erb, T; Zhokhavets, U; Gobsch, G; et al. (2005).Correlation between structural and optical properties of composite polymer/fullerene films for organic solar cells,ADVANCED FUNCTIONAL MATERIALS, Vol.15, No.7, pp.1193-1196.

16

46 Muehlbacher, David; Scharber, Markus; Morana, Mauro; et al. (2006). High photovoltaic performance of a low-bandgap polymer, ADVANCED MATERIALS, Vol.18, No.21, pp.2884-+.

25

18 Dennler, Gilles; Scharber, Markus C.; Ameri, Tayebeh; et al. (2008). Design rules for donors in bulk-heterojunction tandem solar cells-towards 15 % energy-conversion efficiency, ADVANCED MATERIALS, Vol.20, No.3, pp.579-+.

36

18 Mayer, A. C.; Toney, Michael F.; Scully, Shawn R.; et al. (2009). Bimolecular Crystals of Fullerenes in Conjugated Polymers and the Implications of Molecular Mixing for Solar Cells, ADVANCED FUNCTIONAL MATERIALS, Vol.19, No.8, pp.1173-1179.

49

17 Brabec, CJ; Winder, C; Sariciftci, NS; et al. (2002). A low-bandgap semiconducting polymer for photovoltaic devices and infrared emitting diodes, ADVANCED FUNCTIONAL MATERIALS, Vol.12, No.10, pp.709-712.

64

17 Schilinsky, Pavel; Waldauf, Christoph; Brabec, Christoph J. (2006). Performance analysis of printed bulk heterojunction solar cells, ADVANCED FUNCTIONAL MATERIALS, Vol.16, No13, pp.1669-1672.

81

16 Scharber, Markus C.; Koppe, Markus; Gao, Jia; et al. (2010). Influence of the Bridging Atom on the Performance of a Low-Bandgap Bulk Heterojunction Solar Cell, ADVANCED MATERIALS, Vol.22, No.3, pp.367-+.

100

16 Waldauf, C; Schilinsky, P; Perisutti, M; et al. (2003). Solution-processed organic n-type thin-film transistors, ADVANCED MATERIALS, Vol.15, No.24, pp.2084-+.

121

13 Hoth, Claudia N.; Schilinsky, Pavel; Choulis, Stelios A.; et al. (2008). Printing highly efficient organic solar cells, NANO LETTERS, Vol.8, No.9, pp.2806-2813.

7.50 12.00 144

12 Hoth, Claudia N.; Choulis, Stelios A.; Schilinsky, Pavel; et al. (2007). High photovoltaic performance of inkjet printed polymer: Fullerene blends, ADVANCED MATERIALS, Vol.19, No.22, pp.3973-+.

169

Page 13: Research Evaluation Contribution Index h -Indexbeta.garj.org/garjeti/pdf/2014/December/Akira and...Journal Impact Factor is an evaluation index proposed for the evaluation of academic

12 Andreev, A; Matt, G; Brabec, CJ; et al. (2000). Highly anisotropically self-assembled structures of para-sexiphenyl grown by hot-wall epitaxy, ADVANCED MATERIALS, Vol.12, No.9, pp.629-+.

196

12 Morana, M; Azimi, H; Dennler, G; Egelhaaf, HJ; Scharber, M; Forberich, K; Hauch, J; Gaudiana, R; Waller, D; Zhu, ZH; Hingerl, K; van Bavel, SS; Loos, J; Brabec, CJ. (2010). Nanomorphology and Charge Generation in Bulk Heterojunctions Based on Low-Bandgap Dithiophene Polymers with Different Bridging Atoms, ADVANCED FUNCTIONAL MATERIALS, Vol.20, No.7.

225

11 Cravino, A; Schilinsky, P; Brabec, CJ. (2007). Characterization of organic solar cells: the importance of device layout, ADVANCED FUNCTIONAL MATERIALS, Vol.17, No.18.

256

10 Lenes, M; Morana, M; Brabec, CJ; Blom, PWM. (2009). Recombination-Limited Photocurrents in Low Bandgap Polymer/Fullerene Solar Cells, ADVANCED FUNCTIONAL MATERIALS, Vol.19, No.7, pp.1106-1111.

289

7 Maurano, A; Hamilton, R; Shuttle, CG; Ballantyne, AM; Nelson, J; O'Regan, B; Zhang, WM; McCulloch, I; Azimi, H; Morana, M; Brabec, CJ; Durrant, JR. (2010). Recombination Dynamics as a Key Determinant of Open Circuit Voltage in Organic Bulk Heterojunction Solar Cells: A Comparison of Four Different Donor Polymers, ADVANCED MATERIALS, Vol.22, No.44, pp.4987+.

324

4 Koppe, M; Egelhaaf, HJ; Dennler, G; Scharber, MC; Brabec, CJ; Schilinsky, P; Hoth, CN. (2010).Near IR Sensitization of Organic Bulk Heterojunction Solar Cells: Towards Optimization of the Spectral Response of Organic Solar Cells, ADVANCED FUNCTIONAL MATERIALS, Vol.20, No.2, pp.338-346.

361

3 Ameri, T; Dennler, G; Waldauf, C; Azimi, H; Seemann, A; Forberich, K; Hauch, J; Scharber, M; Hingerl, K; Brabec, CJ. (2010). Fabrication, Optical Modeling, and Color Characterization of Semitransparent Bulk-Heterojunction Organic Solar Cells in an Inverted Structure, ADVANCED FUNCTIONAL MATERIALS, Vol.20, No.10, pp.1592-1598.

400

3 Wang, X; Zhang, D; Braun, K; Egelhaaf, HJ; Brabec, CJ; Meixner, AJ. (2010). High-Resolution Spectroscopic Mapping of the Chemical Contrast from Nanometer Domains in P3HT:PCBM Organic Blend Films for Solar-Cell Applications, ADVANCED FUNCTIONAL MATERIALS, Vol.20, No.3, pp.492-499.

441

3 Krantz, J; Richter, M; Spallek, S; Spiecker, E; Brabec, CJ. (2011). Solution-Processed Metallic Nanowire Electrodes as Indium Tin Oxide Replacement for Thin-Film Solar Cells, ADVANCED FUNCTIONAL MATERIALS, Vol.21, No.24, pp.4784-4787.

484

1 Wang, HQ; Batentschuk, M; Osvet, A; Pinna, L; Brabec, CJ. (2011). Rare-Earth Ion Doped Up-Conversion Materials for Photovoltaic Applications, ADVANCED MATERIALS, Vol.23, No.22-23, pp.2675-2680.

529

0 Soci, Cesare; Hwang, In-Wook; Moses, Daniel; et al. (2007). Photoconductivity of a low-bandgap conjugated polymer, ADVANCED FUNCTIONAL MATERIALS, Vol.17, No.4, pp.632-636.

576

0 Matt, GJ; Fromherz, T; Bednorz, M; Zamiri, S; Goncalves, G; Lungenschmied, C; Meissner, D; Sitter, H; Sariciftci, NS; Brabec, CJ; Bauer, G. (2010). Fullerene Sensitized Silicon for Near- to Mid-infrared Light Detection, ADVANCED MATERIALS, Vol.22, No.5,

625 25.00

Page 14: Research Evaluation Contribution Index h -Indexbeta.garj.org/garjeti/pdf/2014/December/Akira and...Journal Impact Factor is an evaluation index proposed for the evaluation of academic

pp.647+.

0 Ashraf, RS; Schroeder, BC; Bronstein, HA; Huang, ZG; Thomas, S; Kline, RJ; Brabec, CJ; Rannou, P; Anthopoulos, TD; Durrant, JR; McCulloch, I. (2013). The Influence of Polymer Purification on Photovoltaic Device Performance of a Series of Indacenodithiophene Donor Polymers, ADVANCED MATERIALS, Vol.25, No.14, pp.2029-2034.

676

0 Krantz, J; Stubhan, T; Richter, M; Spallek, S; Litzov, I; Matt, GJ; Spiecker, E; Brabec, CJ. (2013). Spray-Coated Silver Nanowires as Top Electrode Layer in Semitransparent P3HT:PCBM-Based Organic Solar Cell Devices, ADVANCED FUNCTIONAL MATERIALS, Vol.23, No.13, pp.1711-1717.

729 47.75 23.94

Table 12. List of papers by AA Balandin and Balandin’s hMC

-index, h-index, g-index, A-index, and R-index

Papers Information Compare of Index

Citation Name of the Papers hMC

-index h-index g-index A-index R-index

107 Balandin, Alexander A.; Ghosh, Suchismita; Bao, Wenzhong; et al. (2008). Superior thermal conductivity of single-layer graphene, NANO LETTERS, Vol.8, No.3, pp.902-907.

1

17 Teweldebrhan, D; Goyal, V; Balandin, AA. (2010). Exfoliation and Characterization of Bismuth Telluride Atomic Quintuples and Quasi-Two-Dimensional Crystals, NANO LETTERS, Vol.10, No.4, pp.1209-1218

4

6 Rumyantsev, S; Liu, GX; Shur, MS; Potyrailo, RA; Balandin, AA. (2012). Selective Gas Sensing with a Single Pristine Graphene Transistor, NANO LETTERS, Vol.12, No.5, pp.2294-2298

9

5 Lin, JA; Teweldebrhan, D; Ashraf, K; Liu, GX; Jing, XY; Yan, Z; Li, R; Ozkan, M; Lake, RK; Balandin, AA; Ozkan, CS. (2010).Gating of Single-Layer Graphene with Single-Stranded Deoxyribonucleic Acids, SMALL, Vol.6, No.10, pp.1150-1155.

2.50 4.00 16

3 Shahil, KMF; Balandin, AA. (2012). Graphene-Multilayer Graphene Nanocomposites as Highly Efficient Thermal Interface Materials, NANO LETTERS, Vol.12, No.2, pp.861-867

25

3 Nobile, C; Fonoberov, VA; Kudera, S; Della Torre, A; Ruffino, A; Chilla, G; Kipp, T; Heitmann, D; Manna, L; Cingolani, R; Balandin, AA; Krahne, R. (2007).Confined optical phonon modes in aligned nanorod arrays detected by resonant inelastic light scattering, NANO LETTERS, Vol.7, No.2, pp.476-479.

36

2 Evanoff, K; Khan, J; Balandin, AA; Magasinski, A; Ready, WJ; Fuller, TF; Yushin, G. (2012). Towards Ultrathick Battery Electrodes: Aligned Carbon Nanotube - Enabled Architecture,

49

Page 15: Research Evaluation Contribution Index h -Indexbeta.garj.org/garjeti/pdf/2014/December/Akira and...Journal Impact Factor is an evaluation index proposed for the evaluation of academic

ADVANCED MATERIALS, Vol.24, No.4, pp.533+.

2 Yu, J; Liu, GX; Sumant, AV; Goyal, V; Balandin, AA. (2012).Graphene-on-Diamond Devices with Increased Current-Carrying Capacity: Carbon sp(2)-on-sp(3) Technology, NANO LETTERS, Vol.12, No.3, pp.1603-1608.

64

2 Goli, P; Khan, J; Wickramaratne, D; Lake, RK; Balandin, AA. (2012). Charge Density Waves in Exfoliated Films of van der Waals Materials: Evolution of Raman Spectrum in TiSe2, NANO LETTERS, Vol.12, No.11, pp.5941-5945.

81

1 Fonoberov, VA; Balandin, AA. (2006). Giant enhancement of the carrier mobility in silicon nanowires with diamond coating, NANO LETTERS, Vol.6, No.11, pp.2442-2446.

100

1 Nika, DL; Askerov, AS; Balandin, AA. (2012).Anomalous Size Dependence of the Thermal Conductivity of Graphene Ribbons, NANO LETTERS, Vol.12, No.6, pp.3238-3244.

121

0 Goyal, V; Sumant, AV; Teweldebrhan, D; Balandin, AA. (2012). Direct Low-Temperature Integration of Nanocrystalline Diamond with GaN Substrates for Improved Thermal Management of High-Power Electronics, ADVANCED FUNCTIONAL MATERIALS, Vol.22, No.7, pp.1525-1530.

144 12.0

0

33.75 11.62

Table 13. List of papers by MH Huang and Huang’s hMC

-index, h-index, g-index, A-index, and R-index

Papers Information Compare of Index

Citation Name of the Papers hMC

-index h-index g-index A-index R-index

86 Huang, MH; Wu, YY; Feick, H; Tran, N; Weber, E; Yang, PD. (2001). Catalytic growth of zinc oxide nanowires by vapor transport, ADVANCED MATERIALS, Vol.13, No.2, pp.113-116.

1

13 Huang, MH; Boone, C; Roberts, M; Savage, DE; Lagally, MG; Shaji, N; Qin, H; Blick, R; Nairn, JA; Liu, F. (2005). Nanomechanical architecture of strained bilayer thin films: From design principles to experimental fabrication, ADVANCED MATERIALS, Vol.17, No.23, pp.2860+.

4

4 Kuo, CH; Chen, CH; Huang, MH. (2007). Seed-mediated synthesis of monodispersed Cu2O nanocubes with five different size ranges from 40 to 420 nm, ADVANCED FUNCTIONAL MATERIALS, Vol.17, No.18, pp.3773-3780.

9

4 Huang, MH; Lin, PH. (2012). Shape-Controlled Synthesis of Polyhedral Nanocrystals and Their Facet-Dependent Properties, ADVANCED FUNCTIONAL MATERIALS,

3.33 4.00 16

Page 16: Research Evaluation Contribution Index h -Indexbeta.garj.org/garjeti/pdf/2014/December/Akira and...Journal Impact Factor is an evaluation index proposed for the evaluation of academic

Vol.22, No.1, pp.14-24.

1 Kuo, CH; Chu, YT; Song, YF; Huang, MH. (2011). Cu2O Nanocrystal-Templated Growth of Cu2S Nanocages with Encapsulated Au Nanoparticles and In-Situ Transmission X-ray Microscopy Study, ADVANCED FUNCTIONAL MATERIALS, Vol.21, No.4, pp.792-797.

25

1 Du, BS; Liao, JL; Huang, MH; Lin, CH; Lin, HW; Chi, Y; Pan, HA; Fan, GL; Wong, KT; Lee, GH; Chou, PT. (2012) Os(II) Based Green to Red Phosphors: A Great Prospect for Solution-Processed, Highly Efficient Organic Light-Emitting Diodes, ADVANCED FUNCTIONAL MATERIALS, Vil.22, No.16, pp.3491-3499.

36 6.00 26.75 10.34

Table 14. List of papers by MD Stoller and Stoller’s hMC

-index, h-index, g-index, A-index, and R-index

Papers Information Compare of Index

Citation Name of the Papers hMC

-index h-index g-index A-index R-index

74 Stoller, MD; Park, SJ; Zhu, YW; An, JH;

Ruoff, RS. (2008). Graphene-Based

Ultracapacitors, NANO LETTERS, Vol.8,

No.10, pp.3498-3502.

1

3 Zhang, LL; Zhao, X; Stoller, MD; Zhu,

YW; Ji, HX; Murali, S; Wu, YP; Perales, S;

Clevenger, B; Ruoff, RS. (2012). Highly

Conductive and Porous Activated

Reduced Graphene Oxide Films for

High-Power Supercapacitors, NANO

LETTERS, Vol.12, No.4, pp.1806-1812.

2.00 2.00 4 2.00 38.50 8.77

Discussion

Figures 2–6 show the data from Tables 10–14 along with

number of papers and average number of citations. First,

because Stoller has only two papers, the average number

of citations was high (39). Because the A-index is, by

design, almost the same as the average number of

citations, the A-index will not be considered further. The

values of the h-, g-, and R-indexes increased with number

of papers among the examined authors. For example,

Brabec has the highest number of papers and the highest

score on most indexes. It can be seen that the values of

the h-, g-, and R-indexes are directly proportional to

number of publication papers. In contrast, although the

difference in h-index between Ma and Brabec was 6, the

difference in hMC

-index between them was smaller, at only

2.5. Further, although Balandin was ranked third on the

Page 17: Research Evaluation Contribution Index h -Indexbeta.garj.org/garjeti/pdf/2014/December/Akira and...Journal Impact Factor is an evaluation index proposed for the evaluation of academic

230 Glo. Adv. Res. J. Eng. Technol. Innov.

h-index, Balandin’s ranking was fourth on

These are cases showing that hMC

-index

increase proportionally with number of publi

as the other indexes do.

As described in his curriculum vitae

Brabec has held various posts as listed below

has many papers that cite other works in which he is an

author.

・ 2001 Called to Group leader position at

National Microelectronics Research Centre

・ 2001 Principal research scientist &

leader at Siemens Corporate Technology, Department

Microsystems and Materials, Erlangen, Germany

・ 2004 Appointment as Director at Konarka

Technologies, Lowell, USA

・ 2005 Appointment as CEO for Konarka Austria

・ 2006 Appointment as CTO and VP Konarka

Technologies, Lowell, USA

Glo. Adv. Res. J. Eng. Technol. Innov.

on the hMC

-index.

index does not

number of published papers,

(Brabec 2011),

below, and so he

t cite other works in which he is an

2001 Called to Group leader position at

National Microelectronics Research Centre, Cork, Ireland

2001 Principal research scientist & Project

leader at Siemens Corporate Technology, Department

aterials, Erlangen, Germany

Director at Konarka

CEO for Konarka Austria

CTO and VP Konarka

・ 2007 Member of the Advisory Board of

Progress in Photovoltaics (Wiley VCH)

・ 2009 W3 Professor at

Friedrich-Alexander-Universität Erlangen

(Institute Materials for Electronics and Energy Technology

i-MEET)

・ 2009 Appointment as

ZAE Bayern

In contrast Ma is a young researc

not held the variety of posts that

not have many research collaborators. Therefore his

conventional index values were smaller than

Brabec. However, the difference

was smaller in hMC

-index than in

the Mitsubishi Chemical Distinguished Graduate

Fellowship, published the most

in the past few years, and has been

altogether (Ma 2007). From the above, the

fairly evaluates young researcher

fewer collaborators, by discounting the

to rate of cross-citation.

Fig. 2 hMC

-index of five authors

2007 Member of the Advisory Board of

(Wiley VCH)

2009 W3 Professor at

Universität Erlangen-Nürnberg

(Institute Materials for Electronics and Energy Technology

as Scientific Director of the

researcher (Ma 2007) and has

that Brabec has, so he does

research collaborators. Therefore his

index values were smaller than those of

the difference between Ma and Brabec

in h-index. Ma was awarded

Mitsubishi Chemical Distinguished Graduate

Fellowship, published the most-cited paper on solar cells

and has been cited over 3330 times

. From the above, the hMC

-index more

researchers, who are likely to have

discounting the h-index according

Page 18: Research Evaluation Contribution Index h -Indexbeta.garj.org/garjeti/pdf/2014/December/Akira and...Journal Impact Factor is an evaluation index proposed for the evaluation of academic

Akira and Masayoshi, 231

Fig. 3 h-index of five authors

Fig. 4 g-index of five authors

Fig. 5 A-index of five authors

Akira and Masayoshi, 231

Page 19: Research Evaluation Contribution Index h -Indexbeta.garj.org/garjeti/pdf/2014/December/Akira and...Journal Impact Factor is an evaluation index proposed for the evaluation of academic

232 Glo. Adv. Res. J. Eng. Technol. Innov.

The reason that the difference between Ma and Brabec

number of cross-citations by Brabec is large

represents a paper and each arrow represents

numerous cross-citations, the value of Brabec's

seems likely that the large number of posts held by Brabec has resulted in many collaborators,

cross-citation.

.

Fig. 7 Cross-citation by Ma

Further, we confirm that the result of this evaluation

Glo. Adv. Res. J. Eng. Technol. Innov.

Fig. 6 R-index of five authors

between Ma and Brabec was smaller in hMC

-index than in h-index

is large relative to that of Ma, as shown in Figs. 7 and 8. In th

represents a paper and each arrow represents a citation. We think that because the many papers of Brabec

, the value of Brabec's hMC

-index is reduced more than Ma’s from their respective

seems likely that the large number of posts held by Brabec has resulted in many collaborators,

Fig. 8 Cross-citation by Brabec

e confirm that the result of this evaluation experiment is not exclusive to the query

index (Figs. 2 and 3) is that the

In these figures, each square

citation. We think that because the many papers of Brabec have

om their respective h-indexes. It

seems likely that the large number of posts held by Brabec has resulted in many collaborators, which tends to increase

experiment is not exclusive to the query that we tested.

Page 20: Research Evaluation Contribution Index h -Indexbeta.garj.org/garjeti/pdf/2014/December/Akira and...Journal Impact Factor is an evaluation index proposed for the evaluation of academic

The query "Public Administration" produced a set of

36,252 papers, and performing the same analysis on this

set gave qualitatively similar results.

CONCLUSIONS

In this study, we pointed out that because typical research

contribution indexes are based on published works, these

values tend to be higher for researchers with abundant

experience and those who have many collaborators. We

confirmed this by experiment. The hMC

-index is proposed

as a remedy. In the hMC

-index, the h-index is reduced by

weighting papers according to the number of

Cross-citations. In this way, we created an index that does

not, by its nature, favor older researchers and those with a

larger number of collaborators. This allows fairer treatment

of young researchers, who are likely to have fewer

collaborators. We confirmed that hMC

-index is less

correlated to career length than the h-index through this

evaluation experiment. We hope that people will find the

hMC

-index helpful for evaluating researchers.

REFERENCES

Akira Otsuki, Masayoshi Kawamura (2013). GV-Index: Scientific

Contribution Rating Index That Takes into Account the Growth Degree

of Research Area and Variance Values of the Publication Year of Cited

Paper, International Journal of Data Mining & Knowledge Management

Process (IJDKP), AIRCC, Volume 3, Number 5, pp.1-13, 2013.

Garfield E (1955a). "Citation indexes for science", Science (AAAS) 122

(3159): pp.108–111.

Garfield E. (1955b). Citation indexes to science: a new dimension in

Akira and Masayoshi, 233

documentation through association of ideas, Science 122(3159):

108-11.

Garfield E, Welljams-Dorof A (1992). Of Nobel class: A citation

perspective on high impact research authors, Theoretical Medicine 13

(2), pp.117-135.

Hirsch JE (2007). Does the h index have predictive power?, Proceedings

of the National Academy of Sciences of the United States of America

104 (49), pp. 19193-19198.

Bornmann, Lutz; Daniel, Hans-Dieter (2007). What do we know about

the h index?, JOURNAL OF THE AMERICAN SOCIETY FOR

INFORMATION SCIENCE AND TECHNOLOGY, Vol.58, No.9,

pp.1381-1385.

Egghe L (2006). Theory and practise of the g-index, Scientometrics 69

(1), pp. 131-152.

Jin BH (2006). h-Index: An evaluation indicator proposed by scientist.

Science Focus, 1(1), 8–9. (In Chinese).

Jin BH, Liang LM, Rousseau R, Egghe L (2007). The R- and AR-indices:

Complementing the h-index. Chinese Science Bulletin 52(6):855-863.

Alonso S, Cabrerizo F, Herrera-Viedma E, Herrera F (2010). hg-index:

a new index to characterize the scientific output of researchers based

on the h- and g-indices. Scientometrics, 82(2), pp.391–400.

Antonakis J, Lalive R (2008). Quantifying Scholarly Impact: IQp Versus

the Hirsch h, Journal of the American Society for Information Science

and Technology, Volume 59 Issue 6, pp.956-969.

Web-of-science. (2014). http://thomsonreuters.com/web-of-science/.

Prime Minister of Japan and His Cabinet. (2013).

http://www.kantei.go.jp/jp/singi/bt/link/link.html.

CAO. (2012). "Science and Technology Policy Web Site".

http://www8.cao.go.jp/cstp/sentan/wt2/monbukagakusho5.pdf.

JST. (2013). "Panoramic View of the Nanotechnology/ Materials Field".

http://www.jst.go.jp/crds/pdf/2012/FR/CRDS-FY2012-FR-06.pdf.

C. J. BRABEC. (2011).

http://www.aot.uni-erlangen.de/fileadmin/aot/pdfs/cv_pi/Brabec_CV.p

Page 21: Research Evaluation Contribution Index h -Indexbeta.garj.org/garjeti/pdf/2014/December/Akira and...Journal Impact Factor is an evaluation index proposed for the evaluation of academic

234 Glo. Adv. Res. J. Eng. Technol. Innov.

df.

Ma, Wanli. (2007).

http://funsom.suda.edu.cn/index.aspx?menuid=13&type=articleinfo

&lanmuid=28&infoid=321&language=en.