Evolve Quick Reviews
Public Paper Reviews
Structured preliminary reviews of recent open-access papers, generated and continuously updated by the Evolve analysis engine. Each review condenses what the paper claims, how solid the evidence is, and the questions a rigorous peer reviewer would ask — English analysis with abstracts in your language. These are independent AI analyses, not peer review; the canonical record always lives at the publisher.
The Missing "I Don't Know": Why Three Reasoning-Reliability Findings Converge on Calibrated Abstention
Srijith Ravikumar
Position paper: three LLM reliability findings converge on calibrated abstention; four benchmark reforms proposed. Well-hedged but no new experiments.
Fathom: Per-Query Read Depth for Sparse Decoding over Offloaded KV Caches
Vivek Kalyanarangan
Fathom's per-query variable-depth key scans cut offloaded-KV decode 1.67x at 1M tokens; credible, unusually honest, but no HBM benefit and timing is batch-1.
Reflect, Revise, Reuse: Training-Free Skill Evolution for GUI Agents
Bofan Chen, Boxuan Zhang, Fei Tang, Zhengxi Lu et al.
Training-free GUI skill self-evolution with consistent gains and strong ablations, but lacks significance tests and head-to-head rival baselines.
When the Gradient Sees Rank: Provable Necessity, Causal Recruitment, and Composition in Trained Matrix Memories
Samuel Larson
Trained matrix memories learn task-required rank with a sharp transition at k=K; convincing small-scale evidence, though key analyses rest on single seeds.
Where Grokking Happens: Distributed Utility and Fourier Recoding Without a Module Switch
Dekun Yang
Grokking as distributed Fourier recoding, not a module switch: rigorous frozen exact-game evidence in tiny models; partly utility-sensitive, limited generality.
Disentangling Algorithmic Bias from Archival Artifacts: A Controlled Audit of Vision-Language Model Valuation in Metropolitan Museum Archives
Manpreet Singh, Rhythm Bhatia, Rahul Joshi
A careful CLIP audit of Met artworks finds no significant gender valuation gap, but the authors' own noise-floor argument limits what the null proves.
Pay Only for Disagreement: Certified No-Regression Verdicts for Model Updates with Matching Label-Complexity Bounds
Vishnu Bindu Balachandran
DISCERN certifies model-update safety by labeling only disagreements; anytime-valid guarantees, matching Õ(ρ²/ε²) label bounds, strong experiments, narrow LLM scope.
Long-Lived Characters, Local Inference: Incremental Memory Maintenance for Game NPCs
Zimu Xu
Case study of true-tail KV maintenance for hybrid-model game NPCs; careful scoping and honest claims, but n=1 evidence and a calibrated-only speedup headline.
Beyond Static RAG: An Adaptive, Tri-Metric Routing Framework for Efficient Long-Context Inference on Commodity GPUs
Saipraveen Vabbilisetty, Ajay Kumar Boddepalli, Deep Narayan Mishra, Shashank Kapadia et al.
A training-free tri-metric router that dodges the T4 'Compression Paradox' (0% OOM, +5.2 F1 over BM25-only); useful systems contribution, but core thresholds rest on N=21 calibration.
Safety-Flag: A Unified Benchmark for the Reliability and Calibration of LLM Content Moderators
Yibo Hu
Unifies 7 safety benchmarks into one balanced flag protocol; a solid, openly released benchmark showing error direction, calibration, and abstention diverge across LLM moderators.
Benchmarking Large Language Models for Biomedical Relation Extraction
Claudiu Creanga, Teodor Marchitan, Liviu P. Dinu
Benchmarks LLMs, MLMs and a hybrid on SNPPhenA; O1 few-shot and fine-tuned Gemini 2.0 Pro lead all three tasks, but SOTA margins lack significance tests.
MIRAGE: How Conversation State Shapes Historical Evidence Use in Multimodal Personal Agents
Yu Liu, Wenxiao Zhang, Cheng Hu, Cong Cao et al.
Controlled study showing pre-/post-compaction are distinct grounding-failure regimes; internally convincing, but six artifacts and one runtime bound generality.
When Audit Quality Fails to Predict Downstream Utility: A Counterfactual Study of Synthetic-Data Selectors for Low-Resource African NLP
Son Ha Xuan, Phat T. Tran-Truong, Xuan-Bach Le
Synthetic-data audit rankings decouple from downstream F1 in 8 African-language cells; a transparent, credible case study, though underpowered at a single seed.
Reading Between the Lines: Can LLMs Discover the Question Behind the Text?
Claudiu Creanga, Liviu P. Dinu
'Question archaeology' (infer a text's genesis question) on a 335-text benchmark; Gemini beats humans, but headline metrics and stats are under-specified.
TalkMatrix: Generating Character Dialogue that is Both Consistent and Diverse
Ayuto Tsutsumi, Yuu Jinnai
Selects LLM dialogue candidates jointly per character–situation matrix cell via a minimax objective; well-ablated but validated only by one LLM judge.
A Benchmark Suite and Ground-Truth Methodology for Formal Verification of IEC 61131-3 Ladder Diagram Programs
Pierre Dantas, Lucas Cordeiro, Waldir Junior
First graphical-LD PLC verification benchmark with triangulated ground truth; credible and honest, but cross-tool validation is narrow and self-referential.
Beyond Outcomes: Dual-View Relational Learning for Efficient Agent Benchmarking
Xinshuai Guo, Junjie Wu, Dolly Deng, Yinghui Li et al.
DualViewEval claims SOTA agent-benchmark compression via outcome+process relational learning; five-benchmark results look strong but rest on tiny agent pools without significance testing.
LangSelect: Cost-Aware Target-Language Routing for LLM Code Generation
Son Ha Xuan, Phat T. Tran-Truong, Xuan-Bach Le, Nghia Duong-Trung
Target-language routing is a real code-gen cost lever; accounting is careful, but GPT-5-only evidence and a verbose Python baseline temper the 50.3% headline.
Structured Claim-Level Discourse Representations for Dense Health Narratives
Farnoushsadat Nilizadeh, Elham Pourabbas Vafa, Shirin Nilizadeh, Eduard Dragut
Annotated claim-level health-discourse benchmark with useful context ablations; lacks significance tests, uses test-set-tuned heuristics, no data/code release.
How Much is a Human Right Worth? ECtHR-NPD: A Benchmark for Predicting Non-Pecuniary Damage Awards
Yanyi Pu, Damian A. Gonzalez-Salzberg, Zheng Yuan, Nikolaos Aletras
First ECtHR non-pecuniary-damage award prediction benchmark (14.6k cases); rigorous leakage control, but best model beats a median constant by just 10.2%.
PersonaPath: Towards Knowledge-Centric Personalized Learning Path Planning
Yu Liu, Zeming Liu, Tianle Zhang, Zihao Cheng et al.
New LLM benchmark for personalized learning paths; rigorous build (2,000 personas, 347 textbooks) but simulation-only evaluation; best model passes 29.5%.
DyMT-ESB: Dynamic Multi-Turn Evaluation of Social Bias in User-LLM Interactions
Rem Hida, Masahiro Kaneko, Daisuke Oba, Danushka Bollegala et al.
Response-conditioned multi-turn protocol reveals late, non-monotonic, re-emerging LLM bias; sound design but single generator-judge LLM and thin uncertainty.
HearInContext: A Benchmark for Implicit Context in Speech Recognition
Yifan Gao, Yao Tian, Hongbin Suo
Controlled bilingual benchmark separating implicit vs explicit context in ASR; gains are solid but speech is synthetic and significance untested.
ReFigBench: Benchmarking Scientific Figure Reconstruction as Editable PowerPoint Artifacts
Liyang Fan, Chi Wei, Yitai Li, Xinping Bi et al.
1,000-figure benchmark for editable PPTX reconstruction; a careful paired study shows harness and workflow jointly decide agent quality; broadly convincing, with judge-family caveats.