Stephan Stahlschmidt

Dr. Stephan Stahlschmidt

Research Area Research System and Science Dynamics
Acting Head of Department
  • +49 30 2064177-18
  • +49 30 2064177-99

Academic research fields

Publications

List of publications

Unfortunately, there is no result available for this search combination

On the performativity of SDG classifications in large bibliometric databases.

Ottaviani, M., & Stahlschmidt, S. (2024).
On the performativity of SDG classifications in large bibliometric databases. ArXiv (online first). https://doi.org/10.48550/arXiv.2405.03007
Abstract

This work proposes using the feature of large language models (LLMs) to learn about the "data bias" injected by diverse SDG classifications into bibliometric data by exploring five SDGs. We build a LLM that is fine-tuned in parallel by the diverse SDG classifications inscribed into the databases' SDG classifications. Our results show high sensitivity in model architecture, classified publications, fine-tuning process and natural language generation. The wide arbitrariness at different levels raises concerns about using LLM in research practice.

Contrasting cross-correlation: Meta-analyses of the associations between citations and 13 altmetrics, incorporating moderating variables.

Stephen, D., & Stahlschmidt, S. (2024).
Contrasting cross-correlation: Meta-analyses of the associations between citations and 13 altmetrics, incorporating moderating variables. Scientometrics (online first).

Publikationen aus DFG-geförderten Projekten.

Meier, A., Mittermaier, B., Möller, T., Ottaviani, M., Scheidt, B., & Stahlschmidt, S. (2023).
Publikationen aus DFG-geförderten Projekten. Praxis und Nutzbarkeit von Funding Acknowledgements. Bonn: DFG.

Mind the gap: Nowcasting the citation impact of research institutions.

Stahlschmidt, S., & Stephen, D. (2023).
Mind the gap: Nowcasting the citation impact of research institutions. In ISSI (Hrsg.), Proceedings of ISSI 2023 – the 19th International Conference of the International Society for Scientometrics and Informetrics (S. 441-447). Bloomington, United States: International Society for Scientometrics and Informetrics.

Detection of (non-)existing participation in contested academic discourses.

Aman, V., & Stahlschmidt, S. (2023).
Detection of (non-)existing participation in contested academic discourses. In ISSI (Hrsg.), Proceedings of ISSI 2023 – the 19th International Conference of the International Society for Scientometrics and Informetrics (S. 15-21). Bloomington, United States: International Society for Scientometrics and Informetrics.

Confounding cross-correlation: A meta-analysis of the association between citations and altmetrics.

Stephen, D., & Stahlschmidt, S. (2023).
Confounding cross-correlation: A meta-analysis of the association between citations and altmetrics. In ISSI (Hrsg.), Proceedings of ISSI 2023 – the 19th International Conference of the International Society for Scientometrics and Informetrics (S. 449-454). Bloomington, United States: International Society for Scientometrics and Informetrics.

Landscape study of small journal publishers for the Knowledge Exchange Task & Finish Group for " Small Publishers and the Transition to Open Access " .

Stephen, D., & Stahlschmidt, S. (2022).
Landscape study of small journal publishers for the Knowledge Exchange Task & Finish Group for "Small Publishers and the Transition to Open Access". Berlin: DZHW.

From indexation policies through citation networks to normalized citation impacts: Web of Science, Scopus, and Dimensions as varying resonance chambers.

Stahlschmidt, S., & Stephen, D. (2022).
From indexation policies through citation networks to normalized citation impacts: Web of Science, Scopus, and Dimensions as varying resonance chambers. Scientometrics, 2022 (online first). https://doi.org/10.1007/s11192-022-04309-6

Performance and Structures of the German Science System 2022. Studien zum deutschen Innovationssystem.

Stephen, D., & Stahlschmidt, S. (2022).
Performance and Structures of the German Science System 2022. Studien zum deutschen Innovationssystem. Berlin: Expertenkommission Forschung und Innovation (EFI).

Gastbeitrag: Zur bibliometrischen Messung der internationalen Wissenschaftlermobilität.

Stephen, D., & Stahlschmidt, S. (2021).
Gastbeitrag: Zur bibliometrischen Messung der internationalen Wissenschaftlermobilität. Wissenschaft Weltoffen: Daten und Fakten zur Internationalität von Studium und Forschung in Deutschland und weltweit 2021. Deutschland: Deutscher Akademischer Austauschdienst und Deutsches Zentrum für Hochschul- und Wissenschaftsforschung.

Bibliometrische Standardberichte für wissenschaftliche Einrichtungen und deren Einsatz an Bibliotheken.

Stahlschmidt, S., Donner, P., & Jahn, N. (2021).
Bibliometrische Standardberichte für wissenschaftliche Einrichtungen und deren Einsatz an Bibliotheken. b.i.t. online, 24(3), 269-276.

Differences between Web of Science, Scopus, and Dimensions in structure and citation networks affect German sectors’ normalised citation impact.

Stahlschmidt, S., & Stephen, D. (2021).
Differences between Web of Science, Scopus, and Dimensions in structure and citation networks affect German sectors’ normalised citation impact. In W. Glänzel, S. Heeffer, P.-S. Chi, & R. Rosseau (Hrsg.), Proceedings of the 18th International Conference on Scientometrics and Informetrics (S. 1051-1062). Leuven: KU Leuven / International Society for Scientometrics and Informetrics (I.S.S.I.).

From indexation policies through citation networks to normalized citation impacts: Web of Science, Scopus, and Dimensions as varying resonance chambers.

Stahlschmidt, S., & Stephen, D. (2021).
From indexation policies through citation networks to normalized citation impacts: Web of Science, Scopus, and Dimensions as varying resonance chambers. Ithaca: arXiv.

Performance and Structures of the German Science System 2021.

Stephen, D., & Stahlschmidt, S. (2021).
Performance and Structures of the German Science System 2021. Studien zum deutschen Innovationssystem. Berlin: Expertenkommission Forschung und Innovation (EFI).

Comparison of Web of Science, Scopus and Dimensions databases.

Stahlschmidt, S., & Stephen, D. (2020).
Comparison of Web of Science, Scopus and Dimensions databases. Report to Kompetenzzentrum Bibliometrie. Hannover: DZHW.
Presentations

List of presentations & conferences

Unfortunately, there is no result available for this search combination

Mind the gap: Nowcasting the citation impact of research institutions.

Stahlschmidt, S., & Stephen, D. (2023, November).
Mind the gap: Nowcasting the citation impact of research institutions. Vortrag auf dem Kolloquium Departamento de Información y Comunicación, Universidad de Granada, Granada, Spanien.

On the performativity of SDG classifications in large bibliometric databases.

Ottaviani, M., & Stahlschmidt, S. (2023, Oktober).
On the performativity of SDG classifications in large bibliometric databases. Poster auf der Konferenz Nordic Workshop on Bibliometrics and Research Policy, Gothenburg, Sweden.
Abstract

Large bibliometric databases, such as Web of Science, Scopus and Dimensions, are performative and affect the visibility of scientific outputs and impact measurement. However, these databases do not match the UN's SDGs classifications. This work proposes using large language models (LLM) to learn about data bias injected by diverse SDG classifications. The results show high sensitivity to diverse classifications in model architecture, classified publications, fine-tuning process and natural language generation. The wide arbitrariness raises ethical concerns. Qualitative text analyses can help inform science policy on diverse SDG classifications.

european summer school for scientometrics (esss2023).

Glänzel, W., Debackere, K., Hinze, S., Gauch, S., Stahlschmidt, S., ... & Wieland, M. (2023).
european summer school for scientometrics (esss2023)., Sapienza University, Rom, Italien.

Accuracy and Beyond: Data Quality of Bibliometric Databases.

Stahlschmidt, S. (2023, September).
Accuracy and Beyond: Data Quality of Bibliometric Databases. Vortrag auf der Summer School european summer school for scientometrics (esss), Sapienza University, Rom, Italien.

Detection of (non-)existing participation in contested academic discourses.

Aman, V., & Stahlschmidt, S. (2023, Juli).
Detection of (non-)existing participation in contested academic discourses. Vortrag auf der Konferenz International Conference on Scientometrics and Informetrics (ISSI2023), Indiana University, Bloomington, USA.

Non-Indexed References in Small Open Access Journals: A Hidden Scientific Discourse?

Cruz Romero, R., & Stahlschmidt, S. (2023, Juli).
Non-Indexed References in Small Open Access Journals: A Hidden Scientific Discourse? Poster auf der Konferenz ISSI 2023, International Society for Informetrics and Scientometrics (ISSI), Indiana University, Bloomington, Indiana, USA.
Abstract

This poster shows specific bibliometric data highlighting differences and similarities between journals’ references indexed in the Web of Science (WoS) and Scopus and those that are not. Specifically, this contribution looks at small publishers and their respective journals along the open/closed access formats. The goal is to problematize and assess the visibility and meaning of literature being cited in indexed journals against the literature not listed in these databases. This can shed light into the scientific practices and narratives of different academic disciplines that are defined more nationally or internationally.

Mind the gap: Nowcasting the citation impact of research institutions.

Stahlschmidt, S., & Stephen, D. (2023, Juli).
Mind the gap: Nowcasting the citation impact of research institutions. Vortrag auf der Konferenz International Conference on Scientometrics and Informetrics (ISSI2023), Indiana University, Bloomington, USA.

Confounding cross-correlation: A meta-analysis of the association between citations and altmetrics.

Stephen, D., & Stahlschmidt, S. (2023, Juli).
Confounding cross-correlation: A meta-analysis of the association between citations and altmetrics. Vortrag auf der Konferenz 19th International Conference on Scientometrics and Infometrics, Indiana University, Bloomington, Indiana, USA.

European Summer School of Scientometrics 2022 (esss2022).

Glänzel, W., Debackere, K., Hinze, S., Gauch, S., Stahlschmidt, S., ... & Wieland, M. (2022).
European Summer School of Scientometrics 2022 (esss2022)., Berlin.

Introduction to Bibliometric Data Sources IV: Open Data.

Stahlschmidt, S. (2022, September).
Introduction to Bibliometric Data Sources IV: Open Data. Vortrag auf der Summer School European Summer School of Scientometrics 2022 (esss2022), Berlin.

Accuracy and Beyond: Data Quality of Bibliometric Databases.

Stahlschmidt, S. (2022, September).
Accuracy and Beyond: Data Quality of Bibliometric Databases. Vortrag auf der Summer School European Summer School of Scientometrics 20222 (esss2022), Berlin.

Szientometrie als Gegenstand von Wissenschaftsforschung.

Stahlschmidt, S. (2022, Juli).
Teilnahme an der Podiumsdiskussion Szientometrie als Gegenstand von Wissenschaftsforschung auf dem Symposium Wissenschaftsforschung im Fokus - Potentiale und neue Perspektiven, VolkswagenStiftung, Hannover.

Dimensions im Vergleich: Ein Überblick basierend auf den Arbeiten im Kompetenznetzwerk Bibliometrie (KB).

Stahlschmidt, S. (2022, Juni).
Dimensions im Vergleich: Ein Überblick basierend auf den Arbeiten im Kompetenznetzwerk Bibliometrie (KB). Vortrag in der Bibliometrie User Group, Leibniz Geschäftsstelle.

Challenges for bibliometrics in the era of Open Science and non-academic impact assessment.

Stahlschmidt, S. (2022, Juni).
Teilnahme an der Podiumsdiskussion Challenges for bibliometrics in the era of Open Science and non-academic impact assessment Frontiers of the Evaluation. Workshop in Honour of the Memory of Henk F. Moed, Sapienza University, European Summer School for Scientometrics, Rome, Italy.

Germany in the international science system: Findings from annual EFI report series.

Stephen, D., & Stahlschmidt, S. (2022, Januar).
Germany in the international science system: Findings from annual EFI report series. Vortrag auf dem Seminar OST-KB Scientometric Joint Seminar, Haut Conseil de l’évaluation de la recherche et de l’enseignement supérieur, Observatoire des sciences et techniques (OST).