Early-career NLP researcher at Mainz: LLM evaluation, calibration, and cross-lingual consistency in medical QA
2
papers here
2
reviewed by Evolve
1
first-author
0
corresponding
—
works · OpenAlex
1
h-index · OpenAlex
Bibliometric figures come from OpenAlex (2026-10-16) and cover the author's entire public record, not just the papers listed here. Reproducibility signal comes from Evolve's own reviews.
Research profile
Output—
Output cannot be scored yet: countsByYear covers only 2025–2026, too short a window for a stable volume measure. This axis would track the number, consistency, and trajectory of published and preprint works over time.
Impact—
Impact cannot be scored yet: citation signals (h-index 1, i10-index 0) reflect an exceptionally early career stage rather than influence. This axis would measure citation uptake, usage, and scholarly reach once a longer citation window exists.
Focus100/100
Focus scores at the maximum (100/100): the OpenAlex field distribution assigns 100% of the record to natural language processing, with no secondary field dilution. Topic frequencies reinforce this concentration — topic modeling (18) and NLP techniques (15) dominate, followed by adversarial robustness (9), domain adaptation and few-shot learning (8), and software engineering research (3), all NLP-adjacent. Both Evolve-reviewed 2026 papers are NLP, confirming a deliberately narrow, evaluation-centered agenda.
Collaboration39/100
Collaboration scores 39/100, reflecting a compact co-author network: OpenAlex records only 6 distinct co-authors to date. Recurring partners — Katharina von der Wense, Minh Duc Bui, Abteen Ebrahimi, Sagi Shaier, Peter Herbert Kann, and Manuel Mager — suggest stable small-team work rather than large consortia. Both Evolve-reviewed papers are multi-authored but neither lists Sanz-Guerrero as corresponding author, consistent with a junior, contributing role.
Activity91/100
Activity scores 91/100, driven by a steep recent ramp: counts by year show 13 works in 2025 and 9 in 2026 to date, with 22 works in the trailing three-year window. Both Evolve-reviewed papers appeared in 2026, one as first author. This tempo indicates a highly productive current phase, though the short recorded window means the score rests on limited longitudinal evidence.
Reproducibility38/100
Reproducibility scores 38/100, averaged over 2 assessed papers (reproMean 38). Evolve rates the first-authored calibration position paper low — it names no default metric and adds no new evidence — and the cross-lingual medical-consistency study medium, where thin statistics and persona averaging temper conclusions. The pattern suggests early work that is more conceptual and survey-based than artifact-releasing; concrete code and data release would lift this axis.
Research summary
Mario Sanz-Guerrero is an early-career natural language processing researcher at Johannes Gutenberg University Mainz whose work centers on how large language models should be evaluated and how reliably they behave across languages and domains. The OpenAlex-linked record (identity resolved via ORCID 0009-0001-3581-8369) shows a sharply concentrated profile: the field distribution is 100% natural language processing, and topic frequencies are led by topic modeling (18) and NLP techniques (15), with adversarial robustness (9), domain adaptation and few-shot learning (8), and software engineering research (3) rounding out the mix. Activity is heavily concentrated in the last two recorded years — 13 works in 2025 and 9 in 2026, 22 works in the trailing three-year window — while citation-based indicators remain nascent (h-index 1, i10-index 0). Two Evolve-reviewed papers anchor the qualitative picture. A first-authored 2026 position paper argues that calibration should sit beside every NLP benchmark metric — per Evolve, a persuasive adoption-gap case that names no default metric and adds no new evidence. A second 2026 study collects stakeholder perspectives on cross-lingual consistency of LLMs for medical questions, offering useful first evidence tempered by thin statistics and persona averaging. Frequent co-authors include Katharina von der Wense, Minh Duc Bui, Abteen Ebrahimi, Sagi Shaier, Peter Herbert Kann, and Manuel Mager; with only 6 distinct co-authors on record, the network is compact, and neither reviewed paper lists him as corresponding author.
Collaboration pattern
Sanz-Guerrero works in small teams: OpenAlex lists just 6 distinct co-authors, and the collaboration score of 39 reflects a compact rather than expansive network. The recurring circle spans Katharina von der Wense, Minh Duc Bui, Abteen Ebrahimi, Sagi Shaier, Peter Herbert Kann, and Manuel Mager. Across the two Evolve-reviewed 2026 papers he is first author on the calibration position paper and a middle-position co-author on the medical cross-lingual study, with neither marked corresponding.
Research keywords
Highlights
Position paper makes the case for calibration as a first-class LLM evaluation criterion
First stakeholder evidence on cross-lingual consistency of LLMs for medical questions
Sharply focused NLP agenda with a two-year output ramp
The OpenAlex record assigns 100% of output to natural language processing, led by topic modeling (18) and NLP techniques (15), plus adversarial robustness (9) and domain adaptation / few-shot learning (8). Counts by year jump to 13 works in 2025 and 9 in 2026 so far — 22 works in the trailing three years — while citation indicators (h-index 1, i10-index 0) remain nascent.
Timeline
- 202513 works recorded in OpenAlex — the first full year in the record and the start of a steep activity ramp.
- 20269 works recorded so far in 2026; the first-authored position paper 'Calibration as a First-Class Criterion in LLM Evaluation' appears on arXiv.
- 2026Co-authors 'Perspectives on Cross-Lingual Consistency in LLMs for Medical Questions' on arXiv, in a middle authorship position.
- 2026Trailing three-year output reaches 22 works, while citation indicators remain nascent (h-index 1, i10-index 0).
Papers in the Evolve catalog
Frequent co-authors
About this profile
This profile is AI-structured by Evolve.Pub from public bibliographic data (OpenAlex) and Evolve's own paper reviews. It is not written or endorsed by the researcher unless the profile is claimed. Radar dimensions are computed from real bibliometrics with fixed formulas — raw figures are shown alongside; missing dimensions mean insufficient data, never zero. Errors? Claim the profile to correct or hide it.
- Bibliometric scores are computed from OpenAlex records only (identity: openalex); coverage may differ from other databases.
- Output and impact dimensions are unscored due to insufficient data (h-index 1, i10-index 0); this is an early-stage profile.
- The qualitative assessment rests on 2 Evolve-reviewed papers, both 2026 arXiv preprints not yet peer-reviewed.
- The profile is name-resolved from public bibliographic data (ORCID 0009-0001-3581-8369); no biographical or award information is included.
