
Dr. Stephan Stahlschmidt
Research Area Research System and Science Dynamics
Researcher
- +49 30 2064177-18
Academic research fields
List of projects
List of publications
The representation of SDG-related research in bibliometric databases: persisting imbalances and varying perspectives.Ottaviani, M., & Stahlschmidt, S. (2026).The representation of SDG-related research in bibliometric databases: persisting imbalances and varying perspectives. Scientometrics, 2026 (online first). https://doi.org/10.1007/s11192-026-05857-x Abstract
Bibliometric databases algorithmically assign publications to SDGs to show research’s societal impact, yet their classifications disagree substantially. We fine-tuned three LLMs on SDG-classified abstracts from Web of Science, Scopus and OpenAlex, then applied identical prompts to each, covering five SDGs (three on social equity, two on economic and technological development). Human-feedback-driven analysis of the generated noun phrases shows that the most disadvantaged populations, the poorest countries and underrepresented SDG-target topics are missing, while Global North economic powers stay highly visible. This points to systemic discrimination by LLMs within bibliometric classification frameworks, challenging their assumed neutrality. |
Profitability over representativeness: Mapping the economic research excluded by commercial bibliometric databases.Ottaviani, M., & Stahlschmidt, S. (2026).Profitability over representativeness: Mapping the economic research excluded by commercial bibliometric databases. Berlin: Zenodo. https://doi.org/10.5281/zenodo.23192652 Abstract
Research that bibliometric databases do not index is largely invisible to evaluation. We matched 215,593 RePEc economics records from 2024 to Scopus and OpenAlex by title. Scopus covers 60.4%, OpenAlex 72.7%; 12.4% appear in neither. Exclusion is systematic. Scopus is article- and English-centric (99.6% of covered records in English, 91.6% journal articles), missing most working papers, book chapters and local non-English outlets. OpenAlex closes most gaps, recovering 90.2% of German-language economics versus 0.6% in Scopus and improving Global-South coverage, yet misses some mainstream English-language journals Scopus indexes well. Coverage boundaries thus encode editorial and commercial priorities, not field-internal representativeness. |
Implicit reporting standards in bibliometric research: what can reviewers’ comments tell us about reporting completeness?
Implicit reporting standards in bibliometric research: what can reviewers’ comments tell us about reporting completeness? Quantitative Science Studies, 2026(7), 1223-1244. https://doi.org/10.1162/QSS.a.496 |
On the structural limitations and resulting opportunities of algorithmic gender and country predictions for diversity assessment in research.Ottaviani, M., & Stahlschmidt, S. (2026).On the structural limitations and resulting opportunities of algorithmic gender and country predictions for diversity assessment in research. Berlin: Zenodo. https://doi.org/10.5281/zenodo.20797609 |
On the structural limitations and resulting opportunities of algorithmic gender and country predictions for diversity assessment in research.Ottaviani, M., Heger, C., & Stahlschmidt, S. (2026).On the structural limitations and resulting opportunities of algorithmic gender and country predictions for diversity assessment in research. Berlin: Zenodo. https://doi.org/10.5281/zenodo.20797610 Abstract
Tools like NamSor, which infer gender, country of origin and ethnicity from author names, are increasingly used for diversity monitoring in research policy, yet may embed biases or yield unreliable results. First, we evaluate its gender and country-of-origin classifications against the WiBeF 2019 dataset of about 7,000 self-declared survey responses from Germany-based researchers. Second, we show two policy uses where it performs reliably: evaluating gender equality strategies and monitoring researcher mobility. Third, we examine trade-offs between sample restriction and accuracy, and systematically review publications using NamSor for misleading results. We argue for more critical, prudent use of onomastic tools in diversity assessment. |
Contemporary global research cultures: results from a global survey about research conditions.Lovakov, A., Blümel, C., & Stahlschmidt, S. (2026).Contemporary global research cultures: results from a global survey about research conditions. F1000Research, 2026(15), 591. https://doi.org/10.12688/f1000research.171842.1 |
By linking national scholarly infrastructures we can better understand the impact of global research.Donner, P., Stahlschmidt, S., Nazarovets, S., Cojocaru, I., Razmadze, M., & Sargsyan, S. (1. April 2026).By linking national scholarly infrastructures we can better understand the impact of global research [Blogbeitrag]. Abgerufen von https://blogs.lse.ac.uk/impactofsocialsciences/2026/04/01/by-linking-national-scholarly-infrastructures-we-can-better-understand-the-impact-of-global-research/ Abstract
Global scholarly information systems provide poor coverage for social science and humanities research taking place outside of the anglophone world and in languages other than English. Paul Donner, Stephan Stahschmidt, Serhii Nazarovets, Igor Cojocaru, Irina Cojocaru, Marina Razmadze and Shushanik Sargsyan highlight a range of national initiatives taking place aimed at improving scholarly data for local and national research and argue for the value of their greater integration. |
Policy-driven innovation: The science-policy nexus in artificial intelligence research in Germany.Cruz Romero, R., & Stahlschmidt, S. (2026).Policy-driven innovation: The science-policy nexus in artificial intelligence research in Germany. Berlin: DZHW. https://doi.org/10.31235/osf.io/mtz4d_v1 |
The data infrastructure of the german Kompetenznetzwerk Bibliometrie: An enabling intermediary between raw data and analysis.Schmidt, M., Rimmert, C., Stephen, D., Lenke, C., Donner, P., ... & Stahlschmidt, S. (2025).The data infrastructure of the german Kompetenznetzwerk Bibliometrie: An enabling intermediary between raw data and analysis. Quantitative Science Studies, 1-36 (online first). https://doi.org/10.1162/qss.a.20 |
Bibliodiversity of small academic publishers: The role of open access for impact and visibility.Cruz Romero, R., Stephen, D., & Stahlschmidt, S. (2025).Bibliodiversity of small academic publishers: The role of open access for impact and visibility. Canadian Journal of Information and Library Science (CJILS/RCSIB), 48(1), 146-166. https://doi.org/10.5206/cjils-rcsib.v48i1.22290 |
Does citation context information enhance the validity of citation analysis for measuring research quality? An empirical comparison of peer assessments and enriched citations.Donner, P., Stahlschmidt, S., Haunschild, R., & Bornmann, L. (2025).Does citation context information enhance the validity of citation analysis for measuring research quality? An empirical comparison of peer assessments and enriched citations. Quantitative Science Studies, 6, 967-987 (online first). https://doi.org/10.1162/qss.a.15 Abstract
Since citation context information has entered the Web of Science (Clarivate) in recent years, one wonders whether the legitimacy and soundness of citation analyses for measuring research quality of publications can be improved by considering this information. The legitimacy and soundness of citation analysis can be established by assessing their construct validity. This can be done by studying how citation impact variables relate to generally accepted external validation data, like human expert assessments of research quality.[...] |
Structural and institutional determinants of Open Access publishing: A macro-perspective.Cruz Romero, R., & Stahlschmidt, S. (2025).Structural and institutional determinants of Open Access publishing: A macro-perspective. In S. Sargsyan, W. Glänzel, & G. Abramo (Hrsg.), Proceedings of the 20th International Conference on Scientometrics & Informetrics (ISSI 2025) (S. 2351-2360). Yerevan: International Society for Scientometrics and Informetrics (ISSI). |
Are citation context information stronger related to peer ratings than citation counts? A descriptive analysis.Donner, P., Stahlschmidt, S., Haunschild, R., & Bornmann, L. (2025).Are citation context information stronger related to peer ratings than citation counts? A descriptive analysis. In S. Sargsyan, W. Glänzel, & G. Abramo (Hrsg.), Proceedings of the 20th International Conference on Scientometrics & Informetrics (ISSI 2025) (S. 325-332). Yerevan: International Society for Scientometrics and Informetrics. Abstract
In this study, we investigated whether citation context information is able to increase the validity of citation impact analyses to measure research quality compared to simple citation counts. We analyzed the statistical relationships of information extracted from structured citation context data in the Web of Science (Clarivate) such as the placement of citations within specific sections of an article with post-publication peer review quality ratings from Faculty Opinions (H1 connect), used as an external validity criterion for research quality. The study is based on publications in medicine and life sciences. [...] |
List of presentations & conferences
Leistungsbewertung in der Wissenschaft – Indikatoren, deren Weiterentwicklung und Grenzen.Stahlschmidt, S. (2025, November).Leistungsbewertung in der Wissenschaft – Indikatoren, deren Weiterentwicklung und Grenzen. Vortrag auf der Tagung DAFA Strategisches Forum 2025, Deutsche Agrarforschungsallianz, Berlin. |
On the limitations and opportunities of gender and country predictions for policy analyses.Ottaviani, M. (2025, Oktober).On the limitations and opportunities of gender and country predictions for policy analyses. Vortrag auf dem Workshop 30th Nordic Workshop on Bibliometrics and Research Policy (NWB 2025), Nordic Institute for Studies of Innovation, Research and Education NIFU) together with the University of Bergen, Bergen, Norway. |
Enhancing open bibliometrics: A new role for national bibliometric infrastructures?Stahlschmidt, S., Cojocaru, I., Cojocaru, I., Donner, P., Nazarovets, S., Razmadze, M., & Sargsyan, S. (2025, Oktober).Enhancing open bibliometrics: A new role for national bibliometric infrastructures? Vortrag auf der Konferenz Nordic Workshop on Bibliometrics and Research Policy (NWB2025), NIFU, Bergen, Norway. |
The representation of SDG-related research in bibliometric databases: A conceptual inquiry via LLMs.Ottaviani, M. (2025, September).The representation of SDG-related research in bibliometric databases: A conceptual inquiry via LLMs. Vortrag auf der Konferenz 29th Annual International Conference on Science, Technology and Innovation Indicators 2025 (STI), Bristol, United Kingdom. |
Structural and institutional determinants of Open Access publishing: A macro-perspective.Cruz Romero, R., & Stahlschmidt, S. (2025, Juni).Structural and institutional determinants of Open Access publishing: A macro-perspective. Vortrag auf der Konferenz 20th International Society for Scientometrics and Informetrics (ISSI) Conference, International Society for Scientometrics and Informetrics (ISSI), Yerevan, Armenia. |
Are citation context information stronger related to peer ratings than citation counts? A descriptive analysis.Donner, P., Stahlschmidt, S., Haunschild, R., & Bornmann, L. (2025, Juni).Are citation context information stronger related to peer ratings than citation counts? A descriptive analysis. Vortrag auf der Konferenz 20th International Conference on Scientometrics & Informetrics (ISSI 2025), Yerevan, Armenien. |
Ko-Publikationen für das Monitoring internationaler Hochschulkooperationen: Aussagekraft, Datenquellen und Datennutzung.Stahlschmidt, S. (2025, Juni).Ko-Publikationen für das Monitoring internationaler Hochschulkooperationen: Aussagekraft, Datenquellen und Datennutzung. Impulsvortrag in der 2. Sitzung der Arbeitsgruppe „Indikatoren", Kultusministerkonferenz. |
Guidance List for repOrting Bibliometric AnaLyses (GLOBAL): A two-round modified Delphi Study.Stephen, D. (2025, Juni).Guidance List for repOrting Bibliometric AnaLyses (GLOBAL): A two-round modified Delphi Study. Vortrag im Rahmen der Ad-hoc-Gruppe GLOBAL auf der Konferenz 20th International Society for Scientometrics and Informetrics (ISSI) Conference, Yerevan, Armenia. |
Implicit reporting standards in bibliometric research: What can reviewers’ comments tell us about reporting completeness?
Implicit reporting standards in bibliometric research: What can reviewers’ comments tell us about reporting completeness? Vortrag auf der Konferenz 20th International Society for Scientometrics and Informetrics (ISSI) Conference, Yerevan, Armenia. |
The impact of AI on SDG classifications in bibliometric databases: A conceptual inquiry into policy and research outcomes.Ottaviani, M. (2025, Februar).The impact of AI on SDG classifications in bibliometric databases: A conceptual inquiry into policy and research outcomes. Vortrag auf der Konferenz The use of generative AI for science of science and higher education studies, Università della Svizzera Italiana in Lugano, Switzerland. |
Political-Economic Characteristics of the Open Access Transformation: Exploring the Dimensions of Stagnant Scholarly Outputs.Cruz Romero, R. (2024, November).Political-Economic Characteristics of the Open Access Transformation: Exploring the Dimensions of Stagnant Scholarly Outputs. Poster auf dem Workshop Nordic Workshop on Bibliometrics and Research Policy 2024 (NWB), University of iceland, Reykjavik, Iceland. |