http://orcid.org/0000-0002-4931-6466
Figures
Abstract
Background
The present study aims to elucidate the state of gender equality in high-quality research by analyzing the representation of female authorships in the last decade (from 2008 to 2016).
Methods
Based on the Gendermetrics platform, 293,557 research articles from 54 journals listed in the Nature Index were considered covering the categories Life Science, Multidisciplinary, Earth & Environmental and Chemistry. The core method was the combined analysis of the proportion of female authorships and the female-to-male odds ratio for first, co- and last authorships. The distribution of prestigious authorships was measured by the Prestige Index.
Results
29.8% of all authorships and 33.1% of the first, 31.8% of the co- and 18.1% of the last authorships were held by women. The corresponding female-to-male odds ratio is 1.19 (CI: 1.18–1.20) for first, 1.35 (CI: 1.34–1.36) for co- and 0.47 (CI: 0.46–0.48) for last authorships. Women are underrepresented at prestigious authorships compared to men (Prestige Index = -0.42). The underrepresentation accentuates in highly competitive articles attracting the highest citation rates, namely, articles with many authors and articles that were published in highest-impact journals. More specifically, a large negative correlation between the 5-Year-Impact-Factor of a journal and the female representation at prestigious authorships was revealed (r(52) = -.63, P < .001). Women publish fewer articles compared to men (39.0% female authors are responsible for 29.8% of all authorships) and are underrepresented at productivity levels of more than 2 articles per author. Articles with female key authors are less frequently cited than articles with male key authors. The gender-specific differences in citation rates increase the more authors contribute to an article. Distinct differences at the journal, journal category, continent and country level were revealed. The prognosis for the next decades forecast a very slow harmonization of authorships odds between the two genders.
Citation: Bendels MHK, Müller R, Brueggmann D, Groneberg DA (2018) Gender disparities in high-quality research revealed by Nature Index journals. PLoS ONE 13(1): e0189136. https://doi.org/10.1371/journal.pone.0189136
Editor: Sergi Lozano, Institut Català de Paleoecologia Humana i Evolució Social (IPHES), SPAIN
Received: February 14, 2017; Accepted: November 20, 2017; Published: January 2, 2018
Copyright: © 2018 Bendels et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: The underlying data is public and was retrieved from the Web of Science Core Collection.
Funding: The authors received no specific funding for this work.
Competing interests: The authors have declared that no competing interests exist.
Abbreviations: AAGR, Average Annual Growth Rate; FAOR, Female Authorship Odds Ratio; FAP, Proportion of Female Authorships; PI, Prestige Index
Introduction
Gender inequity in science began to shift into the public eye since the 1970s driven by the movement of Second Wave Feminism, which sparked a growing interest in the subject. For almost half a century, the topic has remained in the focus of the scientific community, despite many initiatives to promote female scientists [1, 2]. Numerous publications in the recent years documented the persistence of a gender gap in science[1–4] leading to discussions about the underlying reasons[5]. Hence, the problem is omnipresent and deeply rooted in the scientific world and warrants constant re-evaluation by sound research methods.
An easy accessible and objective indicator for the successful integration of women in science is the quantification of their scholastic activity as represented by “authorship” in scientific publications [6, 7]. In this context, it is common opinion that “scientific authorship” embodies a type of reward system that does not exclusively honour the pure scientific merit of someone’s intellectual contribution but also reflects hierarchical structures of the research community [8]. In many research areas including life science, chemistry, and earth & environmental science, the position in an author list is important for reasons unrelated to the article's content, namely, prestige and eligibility for research grants. In these research areas, it is common practice that "the first author indicates the person whose work underlies the paper as a whole" [9], whereas the last authorship "indicate a person whose work or role made the study possible without necessarily doing the actual work" [9]. As a consequence, the prestige of authorships follows a ranked order with a higher reputation of first and last authorships and a lower reputation of co-authorships [7, 8, 10]. Moreover, since in the considered scientific fields, early-career researches usually publish as first or co-authors and senior researches preferably as last authors [8, 11], the analysis of authorships permits conclusion regarding the academic status of women in the hierarchical scientific system. This axiomatic view is valid for original articles; however, it should be mentioned that the order of authors is often reversed on review articles [11].
In light of this, 1.) Sugimoto and colleagues published in 2013 a global and cross-disciplinary bibliometric analysis confirming that gender imbalances persist in research output. Specifically, they showed that women are responsible for fewer than 30% of fractionalized authorships worldwide. Moreover, they demonstrated that in the most productive countries, all articles with women in key author positions receive fewer citations than those with men in the same positions [6]. 2.) In 2016, Filardo and colleagues examined changes in representation of women among first authors of original research published in high impact general medical journals from 1994 to 2014 and investigated differences between journals [12]. They reported that female first authorship increased significantly from 27% in 1994 to 37% in 2014, but seemed to have plateaued and to be in decline in some journals [12]. By applying mathematical odds ratios, they further revealed major differences in female odds to secure a first authorship between the journals. 3.) Recently, Long and colleagues [4] compared the percentage of female first and senior authors with the percentage of women practicing in academic gastroenterology. They demonstrated that the proportion of women in the senior author position is less than expected based on the proportion of women among academic gastroenterologists [4]. Specifically, they found that in 2015, 18% of the first authors, but only 10.1% of the senior authors were women. In terms of odds ratio, women had twice the odds to secure first authorships than last authorships [4].
We here applied the methodology on a big-data scale and focused on the representation of female authorships in high-quality research assessing 54 journals of the Nature Index [13]. The Nature Index was created in 2014 and offers a database for the specific analysis of global high impact scientific efforts from the journal categories of Life Science, Multidisciplinary, Earth & Environmental, Chemistry and Physics [13]. The group of journals was independently chosen by researchers as being where they would want to publish their most significant research [13]. The choices reflect thereby researchers' perception of the journals' content, rather than measures such as impact factor [13]. With the exclusion of the field of physics due to the lack of authors´ first names, we analyzed 1,488,989 male and female authorships from 293,557 articles that were published between January 2008 and May 2016.
The purpose of this study is to answer following main questions concerning the integration of women in high-quality research: How is the relative distribution of women among first, co- and last authorships compared to men? How is the temporal dynamics as well as the decade forecast of the female representation? Are there gender-specific differences in productivity and citation rates? Is there a tendency that the representation of women is reduced at highly competitive authorships? Specifically, what is role women tend to have in articles with many authors, e.g. collaborative projects and in articles that are published in the highest-impact journals? Finally, are there strong regional differences between countries and continents regarding the integration of women and do we reveal a correlation between the percentage of female authorships and the female representation at prestigious authorships?
To address these questions, we used odds ratios to measure the relative distribution of women among first, co- and last authorships compared to men and applied the Prestige Index to assess the distribution of prestigious authorships between the two genders.
Materials and methods
Data acquisition & integration
English original research articles were acquired from the Web of Science Core Collection (http://apps.webofknowledge.com/WOS_GeneralSearch_input.do?product=WOS&search_mode=GeneralSearch&SID=C6MGKFyzPSatF6NT7Sf&preferencesSaved=). The study period covers January 1, 2008 to May 18, 2016, yielding 293,557 articles that were published in 54 Nature Index journals [13] from the journal categories Life Science, Multidisciplinary, Earth & Environmental and Chemistry. Except for three journals (Ecology and Ecology Letters and Nature Chemical Biology), all journals were assigned to one single category. The data analysis was performed using the SQL-Server-based Gendermetrics.NET [14] that constitutes a further development of the NewQIS platform [15]. During data integration, authors were generated by grouping the article authorships by name and first names. This means, each author entity is associated with a non-empty set of authorships. Please note this conceptual difference between author and authorship. In total, 693,575 authors affiliated to institutions from 185 countries were considered.
Gender determination
The algorithmic gender determination employed a data table containing the gender (male, female and unisex) of 77.818 first names, as previously described in Bendels et al. [14, 16]. In total, 313,894 (= 45.3%) male authors, 200,280 (= 28.9%) female authors, 60,097 (= 8.7%) unisex authors and 119,304 (= 17.1%) undefined authors were identified with a small inter-annual variability, as illustrated by S2 Fig. Unisex and undefined authors and their associated authorships (in total 532,784) were ignored in further analysis. In total, N = 1,469,925 authorships (Life Science: 600,386; Chemistry: 462,428, Multidisciplinary: 353,003 and Earth & Environmental: 73,172) form the basis for the analysis. The research output of a country was measured by considering the authorships of the affiliated institutions [16]. A single author is thus able to contribute with various authorships to the research output of different countries. Please note that the detection ratio essentially depends on the authors' country as illustrated by S3B Fig. Therefore, an adaptive threshold criterion θ for the exclusion of a country from the country-specific subanalysis was defined (S3A Fig), as recently described in Bendels et al. [14, 16]. In the present analysis, only countries with a detection ratio of at least 76.3% male and female authorships were included in the country-specific subanalysis. In particular, among the top 20 most productive countries, the Asian countries China, South Korea, Singapore, Taiwan (all with high rates of unisex names) and India (with many undefined names) were excluded. It is important to note that the threshold criterion was exclusively applied to the country-specific analysis. A general bibliometric overview is given in S1 Fig.
Proportion of female authorships (FAP) & female authorship odds ratio (FAOR)
The analysis covers first-, co- and last-authorships. In our terminology, co-authorships comprise all authorships between one first and one last-authorship [7, 16]. Corresponding authors as well as equally distributed authorships were not considered. The proportion of female authorships (FAP) is defined as the quotient between the number of female authorships and the total sum of male and female authorships. For a better readability, the FAP is presented as percentage in the text. In addition, the female-to-male authorship odds ratio (FAOR) was calculated including the corresponding confidence intervals at a confidence level of 95%. The FAOR for e.g. the first authorship is calculated by FAORFirst = FemaleOddsFirst / MaleOddsFirst, with FemaleOddsFirst = FemaleNFirst / (FemaleNCo+FemaleNLast) and MaleOddsFirst = MaleNFirst / (MaleNCo+MaleNLast) and FemaleNt and MaleNT defining the number of female and male, respectively, authorships of type t. The FAOR for first authorships is computed by considering all articles. By contrast, the FAORs for last and co-authorships are determined by considering all articles with at least two or three, respectively, authorships. Therefore, single authorships are considered as first authorships. For a concise notation, a triplet was used to indicate the sign of the significant female odd excess to secure a particular authorship. For example, the FAOR-triplet (+, =, -) indicates that women have a significantly higher odds ratio for first authorships, a non-significantly different odds ratio for co-authorships and a significantly lower odds ratio for last authorships compared to men. To increase the statistical significance, the FAP/FAOR-classification was applied for subjects (e.g. continents) with at least 1000 gender-identified authorships.
Prestige Index
The Prestige Index is an indicator for the female odds excess of holding prestigious authorships compared to men [7, 16]. It is defined as the prestige-weighted average of the FAOR excess εt that is calculated over all authorship types t (i.e. for first, co- and last authorships), εt = wt (FAORt− 1), if FAORt ≥ 1, otherwise εt = wt (1–1/FAORt) with the weighting factor wt [16]. In the examined journals and research areas, the prestige of authorships follows, by convention, a ranked order with a higher reputation of first and last authorships and a lower reputation of co-authorships [8]. Furthermore, we performed a test to exclude an alphabetic ordering of the author list (S5 Fig)[17]. Co-authorships were weighted negatively (wco = –1), whereas first and last authorships were weighted positively (wfirst = wlast = 1). This means higher odds for middle authorships decrease the Prestige Index whereas higher odds for first or last authorships increase the Prestige Index. A value of 0 indicates to a gender-neutral distribution of prestigious authorships, whereas a value above (below) 0 indicates to an excess (lack) of prestigious authorships held by women.
Analysis of data
Average annual growth rates (AAGR) were employed to characterize the annual growth of the parameters. In order to assess the global future trend in female authorships a linear projection of FAP, FAOR, and Prestige Index has been carried out. To give a linear forecast for the year y > 2015, we first assessed the number of authorships Nt of type t by Nt(y) = Nt(2015) * (1 + AAGR_Nt)y-2015, with AAGR_Nt defining the average annual growth rate of Nt. Accordingly, the prediction of the FAPt was calculated by FAPt(y) = FAPt(2015) * (1 + AAGR_FAPt)y-2015. The number of female and male authorships was then estimated by FemaleNt(y) = Nt(y) * FAPt(y) and MaleNt(y) = Nt(y) * (1—FAPt(y)), respectively, and applied to calculate the linear projection of FAOR and Prestige Index. The linear correlation between FAP, Prestige Index and Journal-5-Year-Impact-Factor was measured by the Pearson correlation. The statistical significance of differences between two FAPs was tested by a two-sample t-test. Kruskal-Wallis and post-hoc multi-comparison tests were applied to test the null hypothesis whether the not normally distributed (S4 Fig) citation rates were drawn from the same distribution. The significance threshold was set at .05. The analysis and illustration of data was performed using the MATLAB software (Natick, MA, USA).
Results
The global level
On the global level we reveal an underrepresentation of female authorships with a FAP of 29.8%, relatively more female first (33.1%) and female co-authorships (31.8%) and a substantially less fraction of female last authorships (18.1%, Fig 1). The FAP shows a slight increase over the evaluation period (2008: 29.7%, 2016: 31.6%) with an AAGR of 0.7%. The highest AAGR was found for last authorships (1.4%), followed by first authorships (0.7%), and co-authorships (0.4%). The corresponding FAOR is 1.19 (CI: 1.18–1.20) for first authorships, 1.35 (CI: 1.34–1.36) for co-authorships and 0.47 (CI: 0.46–0.48) for last authorships. Thus, men have a more than 2-fold higher odds to secure last authorships on the global level. The differences are statistically significant (p<0.05) for all authorship types. As a result, the global pattern of FAORs is characterized by the FAOR-tuple (+, +, -), which is constantly present over the whole evaluation period. The associated Prestige Index is on average -0.42 indicating a lack of prestigious authorships held by women. The Prestige Index shows a tendency to increase in the last years (2008: -0.54, 2016: -0.41).
(A) The relative frequency of female authorships (FAP, bottom), the pattern of FAORs (with FAOR-triplet, top) and its associated Prestige Index (PI) are depicted by year and averaged over time. The very time-stable and unbalanced FAOR distribution is constantly characterized by the FAOR-pattern (+, +, -). The significantly negative PI points to a lack of prestigious authorships held by women. (B) The FAP exhibits a marginal increase as documented by its average annual growth rate (AAGR) of 0.7% per year with the highest rate for last authorships (1.5%).
Differences across continents
At the level of continents, the FAP ranges from 36.4% in South America to 19.8% in Asia (Table 1). The FAOR-tuple (+, +, -) constitutes the prevalent FAOR-pattern in all continents. In all continents, we found a negative Prestige Index ranging from -0.32 in South America to -0.76 in Asia.
The continents were descendingly ordered by the Prestige Index.
Differences across countries
At the level of countries, we found a wide range of FAPs extending from 17.0% in Japan to 49.5% in Portugal (Table 2). Different FAOR-patterns were identified ranging from unfavorable with the FAOR-tuple (=, +, -) in Poland, Turkey, Argentina, Brazil, Norway, Russia, Czech Republic and Japan, to favorable with the FAOR-tuple (+, =, =) in New Zealand. The predominant FAOR-pattern is characterized by the FAOR-tuple (+, +, -), which is present in Italy, Spain, Israel, France, Greece, Belgium, Sweden, Australia, U.K., Ireland, Canada, the U.S., Austria, the Netherlands, Germany, Switzerland and Denmark.
Interestingly, in almost all countries, women have significantly lower odds for last authorships compared to men. By contrast, Iceland is the only country, where women have significantly higher odds to secure last authorships. Its favorable FAOR with the FAOR-triplet (-, -, +) leads to the highest Prestige Index of all countries (0.43), followed by New Zealand (0.07) providing almost gender-neutral authorship odds (FAOR-triplet (+, =, =)). In all other countries, we revealed negative Prestige Indices pointing to a lack of prestigious authorships held by women (Table 2). In particular, in Turkey–with a high FAP of 40.3% and the most negative Prestige Index of -2.15—men have almost 6-fold higher odds for last authorships, whereas their female counterparts have more than 2-fold higher odds of a less prestigious co-authorship. We reveal no significant correlation between the FAP of a country and its corresponding Prestige Index (r(30) = .17, P>.05).
Differences across journal categories
At the level of journal categories, we reveal the following FAPs: 35.3% for Life Science, 30.6% for Multidisciplinary, 24.0% for Earth & Environmental, and 23.2% for Chemistry (Fig 2A). Remarkably, in all categories, the FAP exhibits a positive annual growth with a relatively higher growth for first and last authorships and a relatively lower growth for co-authorships (Fig 2B). Specifically, the category-specific AAGRs of the FAP are 1.8% for Earth & Environmental, 1.3% for Chemistry, and 0.9% for both, Life Science and Multidisciplinary. The FAOR-patterns of Life Science, Multidisciplinary and Chemistry are characterized by the FAOR-tuple (+, +, -) with clearly negative Prestige Indices: -0.42 in Multidisciplinary, -0.38 in Life Science, and -0.32 in Chemistry. By contrast, the FAOR-pattern of the journal category Earth & Environmental exhibits the FAOR-tuple (+, -, -) with a positive Prestige Index of 0.06.
(A) The subject category Earth & Environmental has much favorable authorship odds for women than other categories. The number of considered male and female authorships is given in brackets. (B) In all categories, the FAP exhibits a positive annual growth with a relatively higher growth for first and last authorships and a relatively lower growth for co-authorships.
Differences across journals
In a next step, we analyze the individual journals that were grouped by their category (Tables 3–6). For the category Life Science, we reveal FAPs that range from 26.0% in Nature Methods to 43.7% in the American Journal of Human Genetics (Table 3). Different FAOR-patterns are present: The most unfavorable pattern—characterized by the FAOR-tuple (-, +, -)—is found in Nature Biotechnology, by contrast, the journal Ecology has the most favorable FAOR-pattern with the tuple (+, =, -). In all journals of this category, men have significant higher odds for a last authorship. Furthermore, the consistently negative Prestige Index–ranging from -0.08 in Ecology to -1.04 in Nature Biotechnology—indicates that men have higher odds to secure prestigious authorships.
The FAP in Multidisciplinary journals ranges from 28.0% in Science to 31.7% in PNAS (Table 4). Science and Nature exhibit the most unfavorable FAOR-pattern, which is characterized by the tuple (-, +, -). In all journals of this category, men have significant higher odds for last authorships, whereas women have always-higher odds for co-authorships. The consistently negative Prestige Index ranges from -0.33 in PNAS to -0.86 in Nature.
The FAP for Earth & Environmental journals ranges from 22.1% in Nature Geoscience to 30.7% in Ecology (Table 5). In all journals of this category, women have higher odds for a first authorship, whereas men have higher odds for a last authorship. Best female odds to secure prestigious authorships are given in the three editions of the Journal of Geophysical Research (Prestige Index ranges from 0.05 to 0.19) and Earth and Planetary Science Letters (0.12). Best male odds for prestigious authorships are found in Ecology Letters (Prestige Index = -0.27).
The last category, Chemistry journals, is characterized by relatively low FAPs ranging from 18.8% in Nature Materials to 29.2% in Nature Chemical Biology (Table 6). In all Chemistry journals, men have significant higher odds for last authorships, whereas women have higher odds for co-authorships, as described above for Multidisciplinary journals. The Prestige Index is consistently negative ranging from -0.80 in Nature Chemistry to -0.08 in Nano Letters.
In summary, in only 5 out of 54 journals women have equal or higher odds for prestigious authorships compared to men (Earth & Planetary Science Letters, the Journals of Geophysical Research, and Geology).
Correlation of journal parameters
We reveal a large negative correlation between the 5-year-impact-factor of a journal and its corresponding Prestige Index (r(52) = -.63, p < .001, Fig 3B). This means, the higher the 5-year-impact factor of a journal is, the lower are the female odds to secure prestigious authorships. By contrast, we do not reveal a correlation between FAP and 5-Year-Impact-Factor of a journal (r(52) = -.01, P>.05, Fig 3A) and between the FAP of a journal and its Prestige Index (r(52) = -.25, P>.05, Fig 3C). However, there is a tendency that a high FAP in a journal is associated with a disproportional high ratio of female co-authorships (Fig 3C).
(A) There is no correlation between the 5-Year-Impact-Factor of a journal and its FAP. (B) A large negative correlation between the 5-Year-Impact-Factor of a journal and its Prestige Index was revealed. (C) The graph shows a small, but not significant negative correlation between the FAP and the Prestige Index of a journal.
Female authorships by authors per article
We also inspect the role women tend to have in collaborative projects, indicated by the number of authors per article. We found a statistically significant (t(25162), p < .001) increase of the FAP from 23.5% for articles with 1–3 authors to 34.9% for articles with more than 15 authors (Fig 4). Concomitantly, the FAOR for prestigious first or last authorships decreases (first: 1.59 to 1.1, last: 0.52 to 0.43), whereas the FAOR for less prestigious co-authorships increases (1.2 to 1.43); the differences were statistically significant. Overall, this leads to a continuous and statistically significant decrease of the Prestige Index from -0.18 for articles with 1–3 authors, to -0.55 for articles with more than 15 authors. In statistical terms, the more authors contribute to an article, the higher is the FAP and the lower is the representation of women at prestigious authorships.
The more authors contribute to an article, the higher is the FAP and the lower is the representation of women at prestigious authorships.
Citation & productivity analysis
The citation analysis reveals that articles with male key authors are more frequently cited than articles with female key authors (Fig 5A). Specifically, articles with a male first or last author have citation rates of 39.2 and 38.6 citations/article, respectively, whereas articles with a female last or first author exhibit citation rates of 35.4 and 34.9 citations/article, respectively. The differences are statistically significant (p<0.01) between male and female groups, but not within a gender group. Articles with a female key authorship are on average below the mean citation rate of 37.5 citations/article. The analysis of combined authorships documents that male-first/male-last and male-first/female-last articles have on average the highest citation rates with 40.2 and 36.8 citations/article, respectively, followed by female-first/male-last and female-first/female-last articles with 35.2 and 33.2 citations/article, respectively (Fig 5A, right). Single-authored articles with a female author have the lowest citation rates with 25.9 citations/article, which differ not statistically from those with a male author (29.2 citations/article). Statistically, the citation rate of an article becomes higher the more authors are involved (Fig 5B), as e.g. the average citation rate of articles with 1–3 authors is 30.0, whereas articles with more than 15 authors are cited on average 80.9 times. The differences in the citation rates between articles with male or female key authorships impose at each article's author count level and increase the more authors contribute to an article (Fig 5B).
(A) The descendingly ordered citation rates shows that articles with male key authorships are more frequently cited than articles with female key authorships. The mean citation rate of 37.5 citations/article is depicted by a dotted line (Kruskal-Wallis test, (*): p < .05 (**): p < .01). (B) Average citation rates of both, ungrouped articles (bars) and articles that were grouped by the gender of their key authorships (lines), plotted as a function of the number of authors. Statistically, the citation rate of an article is higher the more authors are involved. The differences in citation rates between the two genders increase with the number of authors per article. (C) Gender-specific distribution of the number of articles per author. Women dominate the sub-groups 'author has 1 or 2 article(s)'. All other sub-groups are characterized by a relatively over-representation of male authors. This finding correlates with the higher productivity of male authors, as 61.0% male authors are responsible for 70.2% of all authorships.
Regarding scientific productivity, the analysis reveals marked differences between the two genders: Women clearly dominate the sub-groups 'author has one article' and 'authors has two articles', as e.g. 60.0% of the female authors, but only 49.5% of the male authors had published a single article in our dataset (Fig 5C). By contrast, all other sub-groups—with authors that published more than two articles—are characterized by an over-representation of male authors, which becomes higher with increasing productivity. Particularly the sub-group of most productive authors is clearly dominated by men, as 5.2% of the male authors but only 1.8% of the female authors published more than 10 articles. Overall, 61.0% male authors are responsible for 70.2% of all authorships in our data set (Fig 5C), thus indicating a higher productivity of the male authors.
Discussion
Underrepresented at leading positions
In this descriptive study, we analyze the representation of female authorships for the field of high-quality research covering the areas Life Science, Earth & Environmental, Multidisciplinary and Chemistry: The global FAP of 29.0% corresponds very precisely to the previous determined proportion of female authorships for the whole area of science (30%) as published by Lariviere et al. in 2013 [6], but is significantly lower than the FAP revealed for six high-impact medical journals (34.0%) [12] and the research fields of dermatology (43.0%), epilepsy (39.4%) [16], schizophrenia (37.6%) [7], and stroke medicine (36.3%). The proportion of female first (33.1%) and last authorships (18.1%) is higher than the percentage of 29.3% and 14.5%, respectively, that was found for five high-impact gastroenterology journals in 2012 [4]. We identified a global pattern of FAORs that is characterized by the triplet (+, +, -), i.e. higher female odds for first or co-authorships and lower female odds for last authorships compared to men. This uneven distribution of female authors across the different authorships reflects the known structural imbalance of the scientific system [4, 7, 18–21], with just a few female group leaders as last-authors and many female researchers at lower hierarchical level being first- or co-authors.
Moreover, the FAOR-distribution documents a significant lack of prestigious authorships held by women. Numerically, this result stems from the fact that the high FAOR for first-authorships does not compensate the unfavorable FAORs for co- or last authorships. This finding is remarkable, since academic publishing at high prestigious authorships is the core element of career advancement in science [7, 22–24]. Reasons for the relative overrepresentation of female co-authorships could be that the female contributions to articles are less significant than their male coauthors, thereby shifting to lower prestige co-author positions, as discussed by West et al. [3]. Another mechanism could be that men negotiate more successfully for the more prestigious authorship positions [3].
Position affects productivity and citation rate
The lower productivity of female scientists in the field of high-impact research (39% female authors hold 28.9% of the authorships) is consistent with reports from other scientific fields [4, 6, 16, 18, 20, 21, 25]. In particular, we were able to reproduce the clear male overrepresentation at the highest levels of productivity, as shown by Symonds and colleagues [23] for the field of ecology and evolutionary biology. According to our experience, we think that the main factors affecting women's productivity are not higher rejection rates as e.g. demonstrated for the journals Nature Neuroscience[26] and Cortex[27]. It is more likely that the output and submission rates themselves differ by the particular rank of a scientist with a considerable higher output of the primarily male senior scientists [7, 21]. In addition, Reed and colleagues [25] were able to show that that publication rates of men start to increase earlier in their careers compared to women.
What about citations of publications with female key authors? Many previous studies across various disciplines reported that female authors attract fewer citations than their male counterparts [3, 6, 21, 23, 28, 29]. We here extend the results to high impact science and show, that multi-author articles with female authors in key positions are also less frequently cited than those with male key authors. A reason for this is surely the finding that women are less likely to secure prestigious authorships in articles with many authors (Fig 4) attracting the highest citation rates (Fig 5) [30]. This assumption is supported by the fact that single-author articles exhibit no statistically relevant gender disparity in citation rates (Fig 5A, right). This effect is aggravated by the finding that the differences in citation rates between the two genders increase with the number of authors per article (Fig 5B). This means that women are not only relatively more underrepresented at high-impact key authorships, but also attract significantly fewer citations for (high-impact) key authorships compared to the men. It is plausible to assume that the lack of women in leadership positions causes this accentuated female under-representation (structural reasons) [22] since the distribution of key authorships follows, by convention, a hierarchical order [8]. This is even more valid for the highly competitive key authorships in articles with many authors, e.g. collaborative articles. To conclude, the distribution of key authorships in high-impact collaboration articles emerges as one important factor in the generation of gender-specific citation rates. However, it remains unclear, why articles with female key authorships attract constantly fewer citations, particularly also for articles with few authors, as shown by Fig 5B. The reasons for this may be also found in structural reasons as the mainly male senior scientists tend to have more strongly scientific (citation) networks than the female early-career researches [31]. Moreover, men cite themselves more than women do, as shown by Chawla [32]. Methodically, it should be mentioned that the citation analysis mainly covers the situation from the early phase of investigation (2008–2010), due to the time-delayed occurrence of citations and the thus stronger impact of older articles ("Cited Half-Life") [33]. The relatively high average citation rate of 37.5 citations per article compared to other studies from a similar time interval [7, 28], reflects both, scientific quality and impact of the examined articles. It should also be mentioned, that number of citations is dependent on the scientific area.
Most productive countries characterized by high degree of uniformity
When analysing individual countries, we also identify the FAOR-tuple (+, +, -) as being predominant and nearly exclusively present among the 15 most productive countries regardless of female authorship frequencies ranging from 26.1% in Denmark to 49.5% in Italy (Table 2). This surprisingly high uniformity in the gender-specific career dichotomy across the most productive countries is remarkable. However, it is also a sign for the high proportion of early-career female researchers in these countries, who have entered the academic field in the last decades [34, 35]. Japan–with a strong sense of patriarchy in society [36]—occupies a noticeable role among the top 15 productive countries: it has with 17% the lowest FAP, an even more unfavourable FAOR-pattern and a relatively low Prestige Index, thus pointing to a non-advanced integration of female scientists. Concomitantly, the Japanese government recently reported that its world standing in science and technology is falling [37] and introduced a range of policies in response to this, which are designed to recruit top international researchers [38].
By contrast, the countries New Zealand and Iceland may offer inspiration for improving female participation in scientific publishing: These are the only two among the 30 top publishing countries where women have more favorable odds to secure prestige authorships than men. This result strongly correlates to the Global Gender Gap Report 2016, in which Iceland and New Zealand were ranked 1st and 9th, respectively, out of a total of 144 countries in the world[39]. Both countries have had a long history of promoting women's equality as e.g. New Zealand was the first country in the world to give women the right to vote in 1893 by the Electoral Act. Interestingly, Iceland was for centuries a seafaring nation where women were temporarily left to rely on themselves as their husbands traversed the oceans. Today almost 80% of Iceland's women work. Furthermore, as result of mandatory quotas, almost half of board members of listed companies are women, while 65% of Iceland's university students and 41% of the Member of Parliament are female[40]. The Economist recently named Iceland as the world’s best place for working women[41].
Methodically, the comparison of e.g. Turkey to Finland emphasizes the importance to include FAORs and the related Prestige Index in the analysis of authorships (Table 2): Although both countries are characterized by a relatively high proportion of approximately 40% female authorships, Finland has a more favourable FAOR-pattern with considerably higher female odds for prestigious authorships than Turkey. Apparently, the FAOR-distribution reveals two completely different scientific systems regarding the integration of women.
Advanced integration of women in Earth & Environmental
The analysis of journal-categories confirm previous findings regarding the participation of women with highest percentages for the category Life Science and lowest percentages for the category Chemistry[6]. It remains unclear, why the subject category Earth & Environmental has so much favorable authorship odds for women as well as higher AAGRs of female authorships than other categories. However, this outcome is in line with the finding that after the step to first academic position, men and women are promoted from assistant to associate professor at PhD-granting U.S. institutions at comparable rates regardless of the low proportion of female scientists in this scientific field [42]. Moreover, it was recently reported that women have a higher acceptance rate in American Geophysical Union journals than men [43], thus documenting an well-advanced integration of female scientist in this scientific area.
Accentuated female underrepresentation at top journals
At the level of individual journals, we reveal a striking uniformity with respect to female authorship odds: Specifically, in only 5 out of 54 journals women have equal or slightly better odds to secure prestigious authorships. Furthermore, in all journals men have higher odds to be a last-author. Finally, in only 3 out of 54 journals women have lower odds to get a co-authorship compared to men. Evidently, the global gender-imbalances in high impact research are consistently mapped to the related journals. Most remarkably, our analysis further reveals a negative correlation between the 5-Year-Impact-Factor of a journal and the female odds to secure prestigious authorships (Fig 3B). Evidently, the underrepresentation of women accentuates at highly competitive key authorships as shown here for top journals and for articles with many authors. In this context, a parallel can be drawn to studies reporting about significant gender differences in competitive attitudes [44, 45] and power-related goals [46].
Results contradict the socio-dynamic theory of critical mass
Overall, our analysis clearly demonstrates that countries (like New Zealand), journal categories (like Earth & Environmental Journals) or individual journals (like the Journal of Geophysical Research) with a low proportion of female authorships can still provide favourable conditions for women to be driving forces in publishing of high-quality science. This finding contradicts the socio-dynamic theory of critical mass [47] stating that ‘with an increase in relative numbers, minority members are potentially allies, can form coalitions, and can affect the culture of the group’ [48]. Interestingly, we reveal a negative correlation between FAP and Prestige index when grouping articles by author count (Fig 4). This finding suggests that, globally, there is a tendency that high FAPs are regularly associated with a disproportionate high ratio of female co-authorships.
Methodical limitations
This study documents how deriving information about the state of integration of women in the field of high impact science can be done by a bibliometric approach analyzing the gender-specific distribution of authorships. Conceptually, we extend frequency-based approaches [34, 49–51] by considering the female-to-male odds ratios of authorships as well as their different prestige that was measured by a straightforward weighting scheme. Depending on the question posed, other weighting schemes are permissible. The most important limitation related to this fully algorithmic approach with its minimized inter-individual variability is the lack of information regarding academic rank (e.g. Assistant vs. Associate Professor) and degree (e.g. master's degree vs. doctoral degree) of a scholar, its age and employment status (full time vs. part time), which can only be obtained by personal communication, questionnaires or manual inspection of e.g. online profiles, as demonstrated by other studies [4, 21, 34]. Another limitation of our approach is the fact that we had to exclude countries from the country-specific analysis due to a relative high fraction of unisex or unknown first names. The reason behind this is that it is not possible to assess reliably the amount of female or male authors behind a large fraction of e.g. unisex names determined in many Asian countries.
Outlook
To summarize, previous efforts for improving gender equity in high-quality science were successful with respect to relative frequencies and early-career steps as shown here and elsewhere[3]. However, the results are multi-faceted since low female senior author odds were found in every system level screened (continents, countries, journal categories, journals, and authors per article).
Concerning this remarkable gender-specific career dichotomy, it can be argued that one should expect some lag between imbalances in the first and last author positions, as it takes time for younger scholars to become leaders of research groups [3, 4, 28]. This demographic shift seems plausible, as a continuous rise of female first-authorships in the last years has been described in several academic fields [4, 6, 21, 28]. However, we hypothesize in accord with West et al.[3], that this structural imbalance will not change significantly in near future in the field of high quality research due to low annual increase of the FAP (0.7% per year). Moreover, the described unfavorable FAOR-pattern and the negative Prestige Index were continuously present over the whole evaluation period (2008–2016) with a remarkable numerical stability. According to this estimation, a quantitative prognosis of the temporal development of female authorships on the global level up to the year 2025 documents only a particularly slow harmonization of authorship odds and the persistence of the unfavorable FAOR-pattern (Fig 6). In this prognosis, the Prestige Index will remain negative and the FAP is forecast to reach a value of 33.1% in the year 2025. Based on this consideration, we do not except any fundamental changes in the next decade regarding both female authorship odds and frequencies. In line with this assessment, various studies recently report about a remarkable persistence of the gender-specific career dichotomy despite a considerable increase in female first authorships [4, 7, 19, 20, 34].
The prognosis for the next decades forecasts a slow harmonization of authorship odds between the two genders and the persistence of the unfavorable FAOR-pattern with a negative Prestige Index. A FAP of 33.1% is prognosticated for the year 2025.
Conclusions
Given these findings, fundamental questions arise: Does the academic system has to redefine the esteem for female leadership? Will we require an outside-the-box thinking in academic institutions, editorial boards and funding agencies? With regard to recent studies, demonstrating significant gender differences in competitive attitudes [44, 45], power-related goals [46], life priorities [6], and career preferences [52]: will the gender gap in senior positions ever be closed completely?
Regardless which actions are planned to offer new perspectives for female academics, they should not solely focus on relative frequencies but rather strengthen strategies to improve female-specific (authorship) chances in order to overcome the career dichotomy between the two genders. Quantitative indicators could be used as a valuable instrument to monitor the future development. Specifically, the implementation of an annual gender-specific academic rating of institutions and countries may help to seal the persistently "leaky pipeline" of female scientists.
Supporting information
S1 Fig. Bibliometric overview.
(A) The article count increases from 30,599 in 2008 to 38,276 in 2015; the average annual growth rate (AAGR) is 3.3%. (B) The number of authors per article (author-rate) increases from 5.92 authors/article in 2008 to 7.68 authors/article in 2016. (C) The percentage of international collaboration articles monotonically increases from 0.29 in 2008 to 0.40 in 2016 with an AAGR of 4.1%. (D) The fraction of articles grouped the gender of their key authors' documents a quantitative superiority of articles with male key authorships. (E) The fraction of articles is depicted by country (bar plot) and by continent (pie charts). Please note that the sum of percentages is greater than one due to international collaborations. AU = Australia, CA = Canada, CH = Switzerland, CN = China, DE = Germany, ES = Spain, FR = France, GB = United Kingdom, IN = India, IT = Italy, JP = Japan, KR = South Korea, NL = Netherlands, SE = Sweden, US = United States.
https://doi.org/10.1371/journal.pone.0189136.s001
(JPG)
S2 Fig. Gender detection output by time.
The ratios of detected male, female, unisex and undefined authorships ordered by publication year document a relatively small inter-annual variability.
https://doi.org/10.1371/journal.pone.0189136.s002
(TIF)
S3 Fig. Quality of algorithmic gender detection by country.
(A) An adaptive threshold country criterion θ for the inclusion of a country in the country-specific gender analysis was defined by a ROC-like curve incorporating both detection ratio and cumulative author count [14]. In this study, countries with a detection rate of at least θ = 0.763 male + female authors (i.e. 76.3% of all authorships) from N = 95 countries were included in the country-specific analysis. Countries with a large amount of authors are indicated by country code. (B) The result of the algorithmic gender detection—classified as male/female, unisex or undefined—grouped by countries that are ordered in descending order by their publication count, documents a relative high frequency of male/female authors for most of the top 20 countries, with the exception of the Asian countries China (CN), South Korea (KR), Singapore (SG), Taiwan (TW) and India (IN). The latter countries are characterized by a high frequency of unisex (CH, KR, TW, SG) or unknown names (IN) and are excluded (X) from analysis due to the threshold criterion θ (dotted line). AU = Australia, BE = Belgium, CA = Canada, CH = Switzerland, CN = China, DE = Germany, DK = Denmark, ES = Spain, FR = France, GB = United Kingdom, IL = Israel, IN = India, IT = Italy, JP = Japan, KR = South Korea, NL = Netherlands, SG = Singapore, SE = Sweden, TW = Taiwan, US = United States.
https://doi.org/10.1371/journal.pone.0189136.s003
(TIF)
S4 Fig. Probability density function of the citation rate.
The semi-logarithmic plot of the citation count per article (= citation rate) exhibits an exponential-like decreasing probability density function with a mean citation rate of 37.5 citations/article.
https://doi.org/10.1371/journal.pone.0189136.s004
(TIF)
S5 Fig. Test for alphabetical ordering of the author list.
The proportion of publications with an alphabetic ordered author list is depicted with respect to the authors per article (blue). The values correspond very closely to those obtained for randomly ordered author lists (yellow).
https://doi.org/10.1371/journal.pone.0189136.s005
(JPG)
References
- 1. Shen H. Inequality quantified: Mind the gender gap. Nature. 2013;495(7439):22–4. Epub 2013/03/08. pmid:23467149.
- 2. Moss-Racusin CA, Dovidio JF, Brescoll VL, Graham MJ, Handelsman J. Science faculty's subtle gender biases favor male students. Proceedings of the National Academy of Sciences of the United States of America. 2012;109(41):16474–9. Epub 2012/09/19. pmid:22988126; PubMed Central PMCID: PMCPMC3478626.
- 3. West JD, Jacquet J, King MM, Correll SJ, Bergstrom CT. The role of gender in scholarly authorship. PloS one. 2013;8(7):e66212. Epub 2013/07/31. pmid:23894278; PubMed Central PMCID: PMCPMC3718784.
- 4. Long MT, Leszczynski A, Thompson KD, Wasan SK, Calderwood AH. Female authorship in major academic gastroenterology journals: a look over 20 years. Gastrointestinal endoscopy. 2015;81(6):1440–7.e3. Epub 2015/04/19. pmid:25887727.
- 5. Ceci SJ, Williams WM. Understanding current causes of women's underrepresentation in science. Proceedings of the National Academy of Sciences of the United States of America. 2011;108(8):3157–62. Epub 2011/02/09. pmid:21300892; PubMed Central PMCID: PMCPMC3044353.
- 6. Lariviere V, Ni C, Gingras Y, Cronin B, Sugimoto CR. Bibliometrics: global gender disparities in science. Nature. 2013;504(7479):211–3. Epub 2013/12/19. pmid:24350369.
- 7. Bendels MHK, Bauer J, Schoffel N, Groneberg DA. The gender gap in schizophrenia research. Schizophrenia research. 2017. Epub 2017/06/20. pmid:28625742.
- 8. Tscharntke T, Hochberg ME, Rand TA, Resh VH, Krauss J. Author sequence and credit for contributions in multiauthored publications. PLoS Biol. 2007;5(1):e18. Epub 2007/01/18. pmid:17227141; PubMed Central PMCID: PMCPMC1769438.
- 9.
Murphy TF. Authorship and Publication. In: McGee G, editor. Case Studies in Biomedical Research Ethics. 1. edition ed: The MIT Press; 2004. p. 273–305.
- 10. Drenth JP. Multiple authorship: the contribution of senior authors. Jama. 1998;280(3):219–21. Epub 1998/07/24. pmid:9676660.
- 11. Fadeel B. "But many that are first shall be last; and the last shall be first". FASEB journal: official publication of the Federation of American Societies for Experimental Biology. 2009;23(5):1283. Epub 2009/05/02. pmid:19406846.
- 12. Filardo G, da Graca B, Sass DM, Pollock BD, Smith EB, Martinez MA. Trends and comparison of female first authorship in high impact medical journals: observational study (1994–2014). BMJ. 2016;352:i847. Epub 2016/03/05. pmid:26935100; PubMed Central PMCID: PMCPMC4775869.
- 13. Introducing the Index. Nature. 2014;515(7526):S52–3. Epub 2014/11/13. pmid:25390142.
- 14. Bendels MHK, Brüggmann D, Schöffel N, Groneberg DA. Gendermetrics.NET: a novel software for analyzing the gender representation in scientific authoring. J Occup Med Toxicol. 2016;11:43. pmid:27651823
- 15. Groneberg-Kloft B, Fischer TC, Quarcoo D, Scutaru C. New quality and quantity indices in science (NewQIS): the study protocol of an international project. J Occup Med Toxicol. 2009;4:16. Epub 2009/06/27. pmid:19555514; PubMed Central PMCID: PMCPMC2708171.
- 16. Bendels MHK, Wanke E, Schöffel N, Bauer J, Quarcoo D, Groneberg D. Gender equality in academic research on epilepsy—a study on scientific authorships. Epilepsia. 2017. pmid:28857143
- 17. Marusic A, Bosnjak L, Jeroncic A. A systematic review of research on the meaning, ethics and practices of authorship across scholarly disciplines. PloS one. 2011;6(9):e23477. Epub 2011/09/21. pmid:21931600; PubMed Central PMCID: PMCPMC3169533.
- 18.
West M, Curtis J. AAUP faculty gender equity indicators 2006.: American Association of University Professors; 2006 [2006]. Available from: https://www.aaup.org/NR/rdonlyres/63396944-44BE-4ABA-9815-5792D93856F1/0/AAUPGenderEquityIndicators2006.pdf.
- 19. Kaufman RR, Chevan J. The gender gap in peer-reviewed publications by physical therapy faculty members: a productivity puzzle. Physical therapy. 2011;91(1):122–31. Epub 2010/12/04. pmid:21127164.
- 20. Liang T, Zhang C, Khara RM, Harris AC. Assessing the Gap in Female Authorship in Radiology: Trends Over the Past Two Decades. Journal of the American College of Radiology: JACR. 2015;12(7):735–41. Epub 2015/06/03. pmid:26032356.
- 21. Mueller CM, Gaudilliere DK, Kin C, Menorca R, Girod S. Gender disparities in scholarly productivity of US academic surgeons. Journal of Surgical Research. 2016;203(1):28–33. http://dx.doi.org/10.1016/j.jss.2016.03.060 pmid:27338531
- 22. Ramsden P. Describing and explaining research productivity. Higher Education. 1994;28(2):207–26.
- 23. Cikara M, Rudman L, Fiske S. Dearth by a Thousand Cuts? Accounting for Gender Differences in Top-Ranked Publication Rates in Social Psychology. The Journal of social issues. 2012;68(2):263–85. Epub 2012/01/01. pmid:24748688; PubMed Central PMCID: PMCPMC3991494.
- 24. van den Besselaar P, Sandstrom U. Gender differences in research performance and its impact on careers: a longitudinal case study. Scientometrics. 2016;106:143–62. Epub 2016/01/23. pmid:26798162; PubMed Central PMCID: PMCPMC4709377.
- 25. Reed DA, Enders F, Lindor R, McClees M, Lindor KD. Gender differences in academic productivity and leadership appointments of physicians throughout academic careers. Academic medicine: journal of the Association of American Medical Colleges. 2011;86(1):43–7. Epub 2010/11/26. pmid:21099390.
- 26. Schisterman EF, Swanson CW, Lu YL, Mumford SL. The changing face of epidemiology: gender disparities in citations? Epidemiology (Cambridge, Mass). 2016;28(2):159–68. Epub 2016/12/09. pmid:27930394.
- 27. Symonds MR, Gemmell NJ, Braisher TL, Gorringe KL, Elgar MA. Gender differences in publication output: towards an unbiased metric of research performance. PloS one. 2006;1:e127. Epub 2007/01/06. pmid:17205131; PubMed Central PMCID: PMCPMC1762413.
- 28. Figg WD, Dunn L, Liewehr DJ, Steinberg SM, Thurman PW, Barrett JC, et al. Scientific collaboration results in higher citation rates of published articles. Pharmacotherapy. 2006;26(6):759–67. Epub 2006/05/24. pmid:16716129.
- 29. Helitzer DL, Newbill SL, Cardinali G, Morahan PS, Chang S, Magrane D. Changing the Culture of Academic Medicine: Critical Mass or Critical Actors? Journal of women's health (2002). 2017. Epub 2017/01/17. pmid:28092473.
- 30. Chawla DS. Men cite themselves more than women do. Nature. 2016;535(7611):212. Epub 2016/07/16. pmid:27414239.
- 31. Garfield E. The evolution of the Science Citation Index. International microbiology: the official journal of the Spanish Society for Microbiology. 2007;10(1):65–9. Epub 2007/04/05. pmid:17407063.
- 32. Amering M, Schrank B, Sibitz I. The gender gap in high-impact psychiatry journals. Academic medicine: journal of the Association of American Medical Colleges. 2011;86(8):946–52. Epub 2011/06/23. pmid:21694564.
- 33.
Lautenberger DM, Dandar VM, Raezer CL, Sloane RA. The State of Women in Academic Medicine: The Pipeline and Pathways to Leadership, 2013–2014: AAMC 2014 [cited 2016 2016-10-11]. Available from: https://www.aamc.org/members/gwims/statistics/.
- 34.
Iwao S. The Japanese woman: traditional image and changing reality / Sumiko Iwao. New York: Toronto: New York: Free Press; Maxwell Macmillan Canada; Maxwell Macmillan International; 1993.
- 35. Phillips N. Nature Index 2016 Japan. Nature. 2016;531(7594):S97. Epub 2016/03/18. pmid:26982025.
- 36. Phillips N. Striving for a research renaissance. Nature. 2017;543(7646):S7–S. pmid:28328914
- 37. Leopold TA. The Global Gender Gap Report 2016. World Economic Forum. 2016.
- 38.
Hertz N. Why Iceland is the best place in the world to be a woman. The Guardian. 24.10.2016.
- 39.
Team TD. The best—and worst—places to be a working woman. The Economist. 03.03.2016.
- 40. Holmes MA, O'Connell S, Frey C, Ongley L. Gender imbalance in US geoscience academia. Nature Geosci. 2008;1(2):79–82. http://www.nature.com/ngeo/journal/v1/n2/suppinfo/ngeo113_S1.html.
- 41. Witze A. Gender bias found in Earth-science society journals. Nature News. Sep 29, 2016.
- 42. Campbell A. Female competition: causes, constraints, content, and contexts. Journal of sex research. 2004;41(1):16–26. Epub 2004/06/25. pmid:15216421.
- 43. Niederle M, Vesterlund L. Do Women Shy Away From Competition? Do Men Compete Too Much?*. The Quarterly Journal of Economics. 2007;122(3):1067–101.
- 44. Gino F, Wilmuth CA, Brooks AW. Compared to men, women view professional advancement as equally attainable, but less desirable. Proceedings of the National Academy of Sciences of the United States of America. 2015;112(40):12354–9. Epub 2015/09/24. pmid:26392533; PubMed Central PMCID: PMCPMC4603465.
- 45. Childs S, Mona LK. Critical Mass Theory and Women's Political Representation. Political Studies. 2008;56(3):725–36.
- 46. Kanter RM. Some Effects of Proportions on Group Life: Skewed Sex Ratios and Responses to Token Women. American Journal of Sociology. 1977;82(5):965–90.
- 47. Koster C, Klingelhofer D, Groneberg DA, Schwarzer M. Rotavirus—Global research density equalizing mapping and gender analysis. Vaccine. 2016;34(1):90–100. Epub 2015/11/28. pmid:26611203.
- 48. Bundschuh M, Groneberg DA, Klingelhoefer D, Gerber A. Yellow fever disease: density equalizing mapping and gender analysis of international research output. Parasites & vectors. 2013;6:331. Epub 2013/11/20. pmid:24245856; PubMed Central PMCID: PMCPMC3843536.
- 49. Groneberg DA, Braun M, Klingelhoefer D, Bundschuh M, Gerber A. Pancreatitis: Global Research Activities and Gender Imbalances: A Scientometric Approach Using Density-Equalizing Mapping. Pancreas. 2016;45(2):218–27. Epub 2015/10/17. pmid:26474424.
- 50. Bickel J, Ruffin A. Gender-associated differences in matriculating and graduating medical students. Academic medicine: journal of the Association of American Medical Colleges. 1995;70(6):552–9. Epub 1995/06/01. pmid:7786380.
- 51. Groneberg DA, Braun M, Klingelhoefer D, Bundschuh M, Gerber A. Pancreatitis: Global Research Activities and Gender Imbalances: A Scientometric Approach Using Density-Equalizing Mapping. Pancreas. 2016;45(2):218–27. Epub 2015/10/17. pmid:26474424.
- 52. Bickel J, Ruffin A. Gender-associated differences in matriculating and graduating medical students. Academic medicine: journal of the Association of American Medical Colleges. 1995;70(6):552–9. Epub 1995/06/01. pmid:7786380.