University of Illinois Urbana-Champaign researcher in mechanistic interpretability and language-model evaluation
2
papers here
1
reviewed by Evolve
0
first-author
0
corresponding
—
works · OpenAlex
—
h-index · OpenAlex
Bibliometric figures come from OpenAlex (2026-10-17) and cover the author's entire public record, not just the papers listed here. Reproducibility signal comes from Evolve's own reviews.
Research profile
Output—
Not yet scored. This axis measures publication volume, venue spread and authorship roles over time. Only two 2026 arXiv records are visible in this snapshot, too thin to compute a stable output score.
Impact—
Not yet scored. This axis measures citation counts, citation velocity and uptake in follow-up work. No citation data is present in this snapshot, so no impact score is quoted.
Focus100/100
Scored 100 for concentration. The field distribution in this snapshot lists exactly one field — machine learning interpretability (mechanistic interpretability) — with one tagged paper, and that paper, the linear representation hypothesis survey, sits entirely inside it; the second catalog paper carries no field tag. The maximal score therefore reflects a very narrow visible slice rather than a validated long-term specialization.
Collaboration36/100
Scored 36. The snapshot records 5 distinct co-authors across the two catalog papers. Recurring names are Sewoong Lee, Marc E. Canby, Ikhyun Cho, Risham Sidhu and Yoonhwa Jung. Neither record flags her as corresponding author: she sits in the last (senior) position on the interpretability survey and in a middle position on the Minecraft evaluation paper — a supervisory role within small teams rather than a large-network pattern.
Activity—
Not yet scored. This axis measures publishing cadence — output per year and recency of activity. The snapshot spans a single year (2026) with two records, insufficient to estimate a rhythm.
Reproducibility20/100
Scored 20, computed as a mean of 20 over exactly 1 reproducibility-assessed paper. That paper is the linear representation hypothesis survey, rated low for reproducibility readiness: Evolve's verdict notes it proposes a falsifiable Definition 4 and a rigorous taxonomy but includes no new experiments, so it offers no pipeline, code or benchmark others could rerun. With one assessed paper, this score is indicative only.
Research summary
Julia Hockenmaier is a researcher at the University of Illinois Urbana-Champaign, profiled here from public bibliographic data resolved against ORCID 0000-0003-2796-1752. The Evolve-visible slice of her record is a recent, preprint-centered snapshot built on two 2026 arXiv papers. The first, "A Survey on the Linear Representation Hypothesis," places her in the last (senior) author position; Evolve's review credits it with arguing that the linear representation hypothesis is ill-defined unless pinned to a fixed model-layer-feature-dataset tuple, proposing a falsifiable Definition 4, and delivering a rigorous taxonomy spanning linear probing, sparse autoencoders, activation steering and causal abstraction — while noting it adds no new experiments, which matches its low reproducibility-readiness rating. The second, "MineCEraft: Evaluating Language Models as Construction Engineers in the World of Minecraft," has her in a middle author position and has not yet been reviewed, so it carries no field tag, keywords, verdict or slug. Radar scores reflect this thin but concentrated slice: focus is maximal at 100 (the field distribution lists a single field, machine learning interpretability / mechanistic interpretability), collaboration is 36 with 5 distinct co-authors recorded, and reproducibility is 20, computed as a mean of 20 over one assessed paper. Output, impact and activity axes remain unscored for lack of data. Frequent co-authors in the snapshot are Sewoong Lee, Marc E. Canby, Ikhyun Cho, Risham Sidhu and Yoonhwa Jung.
Collaboration pattern
The visible collaboration pattern is compact and recent: 5 distinct co-authors across two 2026 arXiv papers, giving a collaboration score of 36. The recurring group is Sewoong Lee, Marc E. Canby, Ikhyun Cho, Risham Sidhu and Yoonhwa Jung. Hockenmaier holds the last author position on the linear representation hypothesis survey and a middle position on the Minecraft evaluation paper, with no corresponding-author flag on either record — consistent with senior involvement in small teams.
Research keywords
Highlights
A falsifiable definition for the linear representation hypothesis
Benchmarking language models as Minecraft construction engineers
In this 2026 arXiv paper, MineCEraft evaluates language models as construction engineers inside the Minecraft world, with Hockenmaier in a middle author position. It has not yet been through Evolve review, so no field tag, keywords, verdict or slug exist for it; the profile links it to her only through authorship on the record.
A senior-position interpretability record inside a single-year snapshot
Both Evolve-tracked papers fall in 2026, and the interpretability survey places her last among authors without a corresponding-author flag — consistent with a senior supervisory role. With only 5 distinct co-authors recorded and a collaboration score of 36, the visible network is compact, so this highlight reads as early visibility rather than an established multi-year record.
Timeline
- 2026arXiv preprint "A Survey on the Linear Representation Hypothesis" appears with Hockenmaier in the last author position; Evolve review rates its reproducibility readiness low and records the machine learning interpretability field tag.
- 2026Co-authors "MineCEraft: Evaluating Language Models as Construction Engineers in the World of Minecraft" in a middle author position; the record is not yet reviewed by Evolve.
- 2026Both catalog records land in the same year, so the visible profile is a single-year, preprint-stage snapshot; output, impact and activity axes stay unscored for lack of longitudinal data.
Papers in the Evolve catalog
Frequent co-authors
About this profile
This profile is AI-structured by Evolve.Pub from public bibliographic data (OpenAlex) and Evolve's own paper reviews. It is not written or endorsed by the researcher unless the profile is claimed. Radar dimensions are computed from real bibliometrics with fixed formulas — raw figures are shown alongside; missing dimensions mean insufficient data, never zero. Errors? Claim the profile to correct or hide it.
- Bibliometric signals and radar scores are derived from OpenAlex-style public bibliometric data only; no citation counts, h-index or venue rankings are available in this snapshot.
- Only two papers — both 2026 arXiv preprints from the Evolve catalog — are covered, so the profile may not reflect the researcher's full publication history.
- The reproducibility score rests on a single assessed paper (reproMean 20, reproPapers 1), making it indicative rather than robust.
- MineCEraft is unreviewed by Evolve: it has no field tag, keywords, verdict or slug, and identity resolution relies on the provided ORCID.
