Deciphering the US News and World Report Ranking of US Chemistry Graduate Programs

Masaru Kuno (), Mary Prorok (), Shubin Zhang, Huy Huynh and Thurston Miller
Additional contact information
Masaru Kuno: University of Notre Dame
Mary Prorok: University of Notre Dame
Shubin Zhang: University of Notre Dame
Huy Huynh: University of Notre Dame
Thurston Miller: University of Notre Dame

Scientometrics, 2022, vol. 127, issue 5, No 1, 2150 pages

Abstract: Abstract The US News & World Reports (US News) regularly publishes highly influential rankings of graduate programs in the sciences. These rankings are exclusively based on reputational surveys sent to a small subset of faculty experts in a given discipline, namely Directors of Graduate Studies and Department Chairs. No other quantitative metric is used to establish a graduate program’s rank. If reputation alone establishes US News rank, what quantifiable metrics underlie it? The question is an important one when considering that these rankings are widely consulted within higher education circles. These can impact a particular program’s ability to attract top faculty, graduate students, and other researchers who directly contribute to the program’s collective publication, citation, and funding profiles. In this study, we focus on US News’ most recently published peer assessment scores for chemistry graduate programs and establish seven departmental and institutional metrics that correlate with these scores. We find that central to US News rank is a chemistry program’s research visibility and impact as quantified by the median career h-index of its tenured and tenure track (T/TT) faculty, departmental T/TT size, and per capita research expenditures. These three predictor variables account for approximately 84% of the total variability in reported average peer assessment scores. When prestige indicators such as institutional membership in the American Association of Universities and percentage T/TT faculty membership in the US National Academy of Sciences are included, over 88% of the variability in average peer assessment score is accounted for. In whole, a seven-variable statistical model we develop explains nearly 91% of the variability in US News’ average peer assessment scores, which form the basis for its ranking of graduate US chemistry programs. We also explore the possibility that an anchoring effect influences reputational scores by analyzing how rank change complementary cumulative distribution functions evolve with time, following release of the initial 1994 US News and World Reports chemistry graduate program rankings. We find that the likelihood of rank changes increase with time with a t $$_\text {1/2}$$ 1/2 of $$\sim$$ ∼ 20 years.

Keywords: US News; Ranking; Chemistry; Scientometrics (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://link.springer.com/10.1007/s11192-022-04317-6 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:scient:v:127:y:2022:i:5:d:10.1007_s11192-022-04317-6

Ordering information: This journal article can be ordered from
http://www.springer.com/economics/journal/11192

DOI: 10.1007/s11192-022-04317-6

Access Statistics for this article

Scientometrics is currently edited by Wolfgang Glänzel

More articles in Scientometrics from Springer, Akadémiai Kiadó
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().