Stephan Stahlschmidt

Dr. Stephan Stahlschmidt

Research Area Research System and Science Dynamics
Researcher
  • +49 30 2064177-18

Academic research fields

Projects

List of projects

Unfortunately, there is no result available for this search combination
Between Economy and Democracy: Reorganizing Research Evaluation through Metadata in the Digital Era (REREV)
Competence Network for Bibliometrics
Publications

List of publications

Unfortunately, there is no result available for this search combination

The representation of SDG-related research in bibliometric databases: persisting imbalances and varying perspectives.

Ottaviani, M., & Stahlschmidt, S. (2026).
The representation of SDG-related research in bibliometric databases: persisting imbalances and varying perspectives. Scientometrics, 2026 (online first). https://doi.org/10.1007/s11192-026-05857-x
Abstract

Bibliometric databases algorithmically assign publications to SDGs to show research’s societal impact, yet their classifications disagree substantially. We fine-tuned three LLMs on SDG-classified abstracts from Web of Science, Scopus and OpenAlex, then applied identical prompts to each, covering five SDGs (three on social equity, two on economic and technological development). Human-feedback-driven analysis of the generated noun phrases shows that the most disadvantaged populations, the poorest countries and underrepresented SDG-target topics are missing, while Global North economic powers stay highly visible. This points to systemic discrimination by LLMs within bibliometric classification frameworks, challenging their assumed neutrality.

Profitability over representativeness: Mapping the economic research excluded by commercial bibliometric databases.

Ottaviani, M., & Stahlschmidt, S. (2026).
Profitability over representativeness: Mapping the economic research excluded by commercial bibliometric databases. Berlin: Zenodo. https://doi.org/10.5281/zenodo.23192652
Abstract

Research that bibliometric databases do not index is largely invisible to evaluation. We matched 215,593 RePEc economics records from 2024 to Scopus and OpenAlex by title. Scopus covers 60.4%, OpenAlex 72.7%; 12.4% appear in neither. Exclusion is systematic. Scopus is article- and English-centric (99.6% of covered records in English, 91.6% journal articles), missing most working papers, book chapters and local non-English outlets. OpenAlex closes most gaps, recovering 90.2% of German-language economics versus 0.6% in Scopus and improving Global-South coverage, yet misses some mainstream English-language journals Scopus indexes well. Coverage boundaries thus encode editorial and commercial priorities, not field-internal representativeness.

Implicit reporting standards in bibliometric research: what can reviewers’ comments tell us about reporting completeness?

Stephen, D., Schniedermann, A., Lovakov, A., Schmidt, M., Ottaviani, M., ... & Stahlschmidt, S. (2026).
Implicit reporting standards in bibliometric research: what can reviewers’ comments tell us about reporting completeness? Quantitative Science Studies, 2026(7), 1223-1244. https://doi.org/10.1162/QSS.a.496

On the structural limitations and resulting opportunities of algorithmic gender and country predictions for diversity assessment in research.

Ottaviani, M., & Stahlschmidt, S. (2026).
On the structural limitations and resulting opportunities of algorithmic gender and country predictions for diversity assessment in research. Berlin: Zenodo. https://doi.org/10.5281/zenodo.20797609

On the structural limitations and resulting opportunities of algorithmic gender and country predictions for diversity assessment in research.

Ottaviani, M., Heger, C., & Stahlschmidt, S. (2026).
On the structural limitations and resulting opportunities of algorithmic gender and country predictions for diversity assessment in research. Berlin: Zenodo. https://doi.org/10.5281/zenodo.20797610
Abstract

Tools like NamSor, which infer gender, country of origin and ethnicity from author names, are increasingly used for diversity monitoring in research policy, yet may embed biases or yield unreliable results. First, we evaluate its gender and country-of-origin classifications against the WiBeF 2019 dataset of about 7,000 self-declared survey responses from Germany-based researchers. Second, we show two policy uses where it performs reliably: evaluating gender equality strategies and monitoring researcher mobility. Third, we examine trade-offs between sample restriction and accuracy, and systematically review publications using NamSor for misleading results. We argue for more critical, prudent use of onomastic tools in diversity assessment.

Contemporary global research cultures: results from a global survey about research conditions.

Lovakov, A., Blümel, C., & Stahlschmidt, S. (2026).
Contemporary global research cultures: results from a global survey about research conditions. F1000Research, 2026(15), 591. https://doi.org/10.12688/f1000research.171842.1

Forschungsstärke der Europäischen Hochschulallianzen: Vergleichende Synopse.

Stahlschmidt, S. (2026).
Forschungsstärke der Europäischen Hochschulallianzen: Vergleichende Synopse. Hannover: DZHW (nicht zur Veröffentlichung vorgesehen).

By linking national scholarly infrastructures we can better understand the impact of global research.

Donner, P., Stahlschmidt, S., Nazarovets, S., Cojocaru, I., Razmadze, M., & Sargsyan, S. (1. April 2026).
By linking national scholarly infrastructures we can better understand the impact of global research [Blogbeitrag]. Abgerufen von https://blogs.lse.ac.uk/impactofsocialsciences/2026/04/01/by-linking-national-scholarly-infrastructures-we-can-better-understand-the-impact-of-global-research/
Abstract

Global scholarly information systems provide poor coverage for social science and humanities research taking place outside of the anglophone world and in languages other than English. Paul Donner, Stephan Stahschmidt, Serhii Nazarovets, Igor Cojocaru, Irina Cojocaru, Marina Razmadze and Shushanik Sargsyan highlight a range of national initiatives taking place aimed at improving scholarly data for local and national research and argue for the value of their greater integration.

Policy-driven innovation: The science-policy nexus in artificial intelligence research in Germany.

Cruz Romero, R., & Stahlschmidt, S. (2026).
Policy-driven innovation: The science-policy nexus in artificial intelligence research in Germany. Berlin: DZHW. https://doi.org/10.31235/osf.io/mtz4d_v1

Offene oder proprietäre Daten? Digitalisierung, Kommerzialisierung und Nutzung von Forschungsinformation.

Bartl, G., Krüger, A., & Stahlschmidt, S. (2026).
Offene oder proprietäre Daten? Digitalisierung, Kommerzialisierung und Nutzung von Forschungsinformation. Forschung & Lehre, 2026(1), 20-22.

The data infrastructure of the german Kompetenznetzwerk Bibliometrie: An enabling intermediary between raw data and analysis.

Schmidt, M., Rimmert, C., Stephen, D., Lenke, C., Donner, P., ... & Stahlschmidt, S. (2025).
The data infrastructure of the german Kompetenznetzwerk Bibliometrie: An enabling intermediary between raw data and analysis. Quantitative Science Studies, 1-36 (online first). https://doi.org/10.1162/qss.a.20

Bibliodiversity of small academic publishers: The role of open access for impact and visibility.

Cruz Romero, R., Stephen, D., & Stahlschmidt, S. (2025).
Bibliodiversity of small academic publishers: The role of open access for impact and visibility. Canadian Journal of Information and Library Science (CJILS/RCSIB), 48(1), 146-166. https://doi.org/10.5206/cjils-rcsib.v48i1.22290

Does citation context information enhance the validity of citation analysis for measuring research quality? An empirical comparison of peer assessments and enriched citations.

Donner, P., Stahlschmidt, S., Haunschild, R., & Bornmann, L. (2025).
Does citation context information enhance the validity of citation analysis for measuring research quality? An empirical comparison of peer assessments and enriched citations. Quantitative Science Studies, 6, 967-987 (online first). https://doi.org/10.1162/qss.a.15
Abstract

Since citation context information has entered the Web of Science (Clarivate) in recent years, one wonders whether the legitimacy and soundness of citation analyses for measuring research quality of publications can be improved by considering this information. The legitimacy and soundness of citation analysis can be established by assessing their construct validity. This can be done by studying how citation impact variables relate to generally accepted external validation data, like human expert assessments of research quality.[...]

Structural and institutional determinants of Open Access publishing: A macro-perspective.

Cruz Romero, R., & Stahlschmidt, S. (2025).
Structural and institutional determinants of Open Access publishing: A macro-perspective. In S. Sargsyan, W. Glänzel, & G. Abramo (Hrsg.), Proceedings of the 20th International Conference on Scientometrics & Informetrics (ISSI 2025) (S. 2351-2360). Yerevan: International Society for Scientometrics and Informetrics (ISSI).

Are citation context information stronger related to peer ratings than citation counts? A descriptive analysis.

Donner, P., Stahlschmidt, S., Haunschild, R., & Bornmann, L. (2025).
Are citation context information stronger related to peer ratings than citation counts? A descriptive analysis. In S. Sargsyan, W. Glänzel, & G. Abramo (Hrsg.), Proceedings of the 20th International Conference on Scientometrics & Informetrics (ISSI 2025) (S. 325-332). Yerevan: International Society for Scientometrics and Informetrics.
Abstract

In this study, we investigated whether citation context information is able to increase the validity of citation impact analyses to measure research quality compared to simple citation counts. We analyzed the statistical relationships of information extracted from structured citation context data in the Web of Science (Clarivate) such as the placement of citations within specific sections of an article with post-publication peer review quality ratings from Faculty Opinions (H1 connect), used as an external validity criterion for research quality. The study is based on publications in medicine and life sciences. [...]

Presentations

List of presentations & conferences

Unfortunately, there is no result available for this search combination

european summer school for scientometrics (esss2026).

Arroyo Machado, W., Avenali, A., Daraio, C., Dullinger, I., Gauch, S., ... & Torres Salinas, D. (2026).
european summer school for scientometrics (esss2026)., KU Leuven, Leuven, Belgium.

Accuracy and beyond: Data quality of bibliometric databases.

Stahlschmidt, S. (2026, August/September).
Accuracy and beyond: Data quality of bibliometric databases. Vortrag auf der Summer School European Summer School for Scientometrics (esss2026), KU Leuven, Leuven, Belgium.

Leistungsbewertung in der Wissenschaft – Indikatoren, deren Weiterentwicklung und Grenzen.

Stahlschmidt, S. (2025, November).
Leistungsbewertung in der Wissenschaft – Indikatoren, deren Weiterentwicklung und Grenzen. Vortrag auf der Tagung DAFA Strategisches Forum 2025, Deutsche Agrarforschungsallianz, Berlin.

On the limitations and opportunities of gender and country predictions for policy analyses.

Ottaviani, M. (2025, Oktober).
On the limitations and opportunities of gender and country predictions for policy analyses. Vortrag auf dem Workshop 30th Nordic Workshop on Bibliometrics and Research Policy (NWB 2025), Nordic Institute for Studies of Innovation, Research and Education NIFU) together with the University of Bergen, Bergen, Norway.

Enhancing open bibliometrics: A new role for national bibliometric infrastructures?

Stahlschmidt, S., Cojocaru, I., Cojocaru, I., Donner, P., Nazarovets, S., Razmadze, M., & Sargsyan, S. (2025, Oktober).
Enhancing open bibliometrics: A new role for national bibliometric infrastructures? Vortrag auf der Konferenz Nordic Workshop on Bibliometrics and Research Policy (NWB2025), NIFU, Bergen, Norway.

European Summer School for Scientometrics (esss2025).

Glänzel, W., Thijs, B., Hinze, S., Gauch, S., Stahlschmidt, S., ... & Gorraiz, J. (2025).
European Summer School for Scientometrics (esss2025)., Universidad de Granada, Granada, Spain.

Accuracy and Beyond: Data Quality of Bibliometric Databases.

Stahlschmidt, S. (2025, September).
Accuracy and Beyond: Data Quality of Bibliometric Databases. Vortrag auf der Summer School European Summer School for Scientometrics (esss2025), Universidad de Granada, Granda, Spain.

The representation of SDG-related research in bibliometric databases: A conceptual inquiry via LLMs.

Ottaviani, M. (2025, September).
The representation of SDG-related research in bibliometric databases: A conceptual inquiry via LLMs. Vortrag auf der Konferenz 29th Annual International Conference on Science, Technology and Innovation Indicators 2025 (STI), Bristol, United Kingdom.

Structural and institutional determinants of Open Access publishing: A macro-perspective.

Cruz Romero, R., & Stahlschmidt, S. (2025, Juni).
Structural and institutional determinants of Open Access publishing: A macro-perspective. Vortrag auf der Konferenz 20th International Society for Scientometrics and Informetrics (ISSI) Conference, International Society for Scientometrics and Informetrics (ISSI), Yerevan, Armenia.

Are citation context information stronger related to peer ratings than citation counts? A descriptive analysis.

Donner, P., Stahlschmidt, S., Haunschild, R., & Bornmann, L. (2025, Juni).
Are citation context information stronger related to peer ratings than citation counts? A descriptive analysis. Vortrag auf der Konferenz 20th International Conference on Scientometrics & Informetrics (ISSI 2025), Yerevan, Armenien.

Ko-Publikationen für das Monitoring internationaler Hochschulkooperationen: Aussagekraft, Datenquellen und Datennutzung.

Stahlschmidt, S. (2025, Juni).
Ko-Publikationen für das Monitoring internationaler Hochschulkooperationen: Aussagekraft, Datenquellen und Datennutzung. Impulsvortrag in der 2. Sitzung der Arbeitsgruppe „Indikatoren", Kultusministerkonferenz.

Guidance List for repOrting Bibliometric AnaLyses (GLOBAL): A two-round modified Delphi Study.

Stephen, D. (2025, Juni).
Guidance List for repOrting Bibliometric AnaLyses (GLOBAL): A two-round modified Delphi Study. Vortrag im Rahmen der Ad-hoc-Gruppe GLOBAL auf der Konferenz 20th International Society for Scientometrics and Informetrics (ISSI) Conference, Yerevan, Armenia.

Implicit reporting standards in bibliometric research: What can reviewers’ comments tell us about reporting completeness?

Stephen, D., Schniedermann, A., Lovakov, A., Schmidt, M., Ottaviani, M., ... & Stahlschmidt, S. (2025, Juni).
Implicit reporting standards in bibliometric research: What can reviewers’ comments tell us about reporting completeness? Vortrag auf der Konferenz 20th International Society for Scientometrics and Informetrics (ISSI) Conference, Yerevan, Armenia.

The impact of AI on SDG classifications in bibliometric databases: A conceptual inquiry into policy and research outcomes.

Ottaviani, M. (2025, Februar).
The impact of AI on SDG classifications in bibliometric databases: A conceptual inquiry into policy and research outcomes. Vortrag auf der Konferenz The use of generative AI for science of science and higher education studies, Università della Svizzera Italiana in Lugano, Switzerland.

Political-Economic Characteristics of the Open Access Transformation: Exploring the Dimensions of Stagnant Scholarly Outputs.

Cruz Romero, R. (2024, November).
Political-Economic Characteristics of the Open Access Transformation: Exploring the Dimensions of Stagnant Scholarly Outputs. Poster auf dem Workshop Nordic Workshop on Bibliometrics and Research Policy 2024 (NWB), University of iceland, Reykjavik, Iceland.