Gender issues in fundamental physics: Strumia’s bibliometric analysis fails to account for key confounders and confuses correlation with causation

Abstract

Alessandro Strumia recently published a survey of gender differences in publications and citations in high-energy physics (HEP). In addition to providing full access to the data, code, and methodology, Strumia (2021) systematically describes and accounts for gender differences in HEP citation networks. His analysis points both to ongoing difficulties in attracting women to HEP and an encouraging—though slow—trend in improvement. Unfortunately, however, the time and effort that Strumia (2021) devoted to collating and quantifying the data are not matched by a similar rigor in interpreting the results. To support his conclusions, he selectively cites available literature and fails to adequately adjust for a range of confounding factors. For example, his analyses do not consider how unobserved factors—for example, a tendency to overcite well-known authors—drive a wedge between quality and citations and correlate with author gender. He also fails to take into account many structural and nonstructural factors—including, but not limited to, direct discrimination and the expectations that women form (and actions they take) in response to it—that undoubtedly lead to gender differences in productivity. We therefore believe that a number of Strumia’s conclusions are not supported by his analysis. Indeed, we reanalyze a subsample of solo-authored papers from his data, adjusting for year and journal of publication, authors’ research age and their lifetime “fame.” Our reanalysis suggests that female-authored papers are actually cited more than male-authored papers. This finding is inconsistent with the “greater male variability” hypothesis that Strumia (2021) proposes to explain many of his results. In the conclusion to his paper, Strumia states that “… dealing with complex systems, any simple interpretation can easily be incomplete …”. We agree entirely. Strumia’s simple—and, more importantly, simplistic—analysis and interpretation are far from complete.

Publication DOI: https://doi.org/10.1162/qss_a_00117
Divisions: College of Health & Life Sciences > School of Psychology
Additional Information: Copyright © 2021 Philip Ball, T. Benjamin Britton, Erin Hengel, Philip Moriarty, Rachel A. Oliver, Gina Rippon, Angela Saini, and Jessica Wade. Published under a Creative Commons Attribution 4.0 International (CC BY 4.0) license. This is an open-access article distributed under the terms of the Creative Commons Attribution 4.0 International License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. For a full description of the license, please visit https://creativecommons.org/licenses/by/4.0/legalcode.
Uncontrolled Keywords: Analysis,Numerical Analysis,Cultural Studies,Library and Information Sciences
Publication ISSN: 2641-3337
Last Modified: 31 Mar 2025 07:27
Date Deposited: 03 Jan 2025 15:08
Full Text Link:
Related URLs: http://www.scop ... tnerID=8YFLogxK (Scopus URL)
https://direct. ... ysics-Strumia-s (Publisher URL)
PURE Output Type: Letter
Published Date: 2021-04-08
Authors: Ball, Philip
Britton, T. Benjamin
Hengel, Erin
Moriarty, Philip
Oliver, Rachel A.
Rippon, Gina (ORCID Profile 0000-0001-9807-4945)
Saini, Angela
Wade, Jessica

Download

[img]

Version: Published Version

License: Creative Commons Attribution

| Preview

Export / Share Citation


Statistics

Additional statistics for this record