Investigating document type discrepancies between OpenAlex and the Web of Science

Philippe Mongeon, Madelaine Hare, Geoff Krause, Rebecca Marjoram, Poppy Riddle, Rémi Toupin, Summer Wilson
In-Person, Papers

Abstract

Bibliometrics, whether used for research or research evaluation, relies on large multidisciplinary databases of research outputs and citation indices. The Web of Science (WoS) was the main supporting infrastructure of the field for more than 30 years until several new competitors emerged. OpenAlex, launched in 2022, stands out for its openness and extensive coverage. While OpenAlex may reduce or eliminate barriers to accessing bibliometric data, one of the concerns that hinder its broader adoption for research and research evaluation is the quality of its metadata. This study aims to assess the metadata quality of works in OpenAlex and WoS, focusing on document type accuracy. We observe that over 4% of the publications indexed in both OpenAlex and WoS appear to be misclassified as research articles or reviews, and that the vast majority (about 97%) of these errors occur in OpenAlex. By addressing discrepancies and misattributions in document types this research seeks to enhance awareness of data quality issues that could impact bibliometric research and evaluation outcomes.

Date
May 29, 2025 10:55 ADT — 11:20 ADT
Location
Rowe 1007 and Zoom
Bibliometrics Document Type Library and Information Science Metadata Open Data OpenAlex Research Evaluation Web of Science
Philippe Mongeon
Philippe Mongeon
Department of Information Science, Dalhousie University

Philippe Mongeon is Associate Professor and Chair of the Department of information Science of Dalhousie University, where he runs the Quantitative Science Studies (QSS) Lab. He is also the editor-in-chief of the Canadian Journal of Information and Library Science (CJILS). His research uses bibliometrics and other quantitative methods to study the dynamics and practices of knowledge production, dissemination and use, as well as research evaluation and governance. He works on a broad range of more specific topics, such as research collaboration, scientific misconduct, scholarly publishing, data sharing, research funding, social media, networks, and the evolution of scientific fields.

Madelaine Hare
Madelaine Hare
Digital Transformation & Innovation PhD student, University of Ottawa
Geoff Krause
Geoff Krause
ID PhD Program, Dalhousie University
Rebecca Marjoram
Rebecca Marjoram
Master of Information, Dalhousie University
Poppy Riddle
ID PhD Program, Dalhousie University

I am a PhD student researching how searching for information may be improved. I am working at the intersection of information seeking behaviour, scientometrics, and human-computer interaction.