Evolve Quick Reviews
Public Paper Reviews
Structured preliminary reviews of recent open-access papers, generated and continuously updated by the Evolve analysis engine. Each review condenses what the paper claims, how solid the evidence is, and the questions a rigorous peer reviewer would ask — English analysis with abstracts in your language. These are independent AI analyses, not peer review; the canonical record always lives at the publisher.
How AI Assistants Respond to Repeated Abuse
William Guey, Wei Zhang, Pierrick Bougault, Yi Wang et al.
Claims refusal is not one axis: AI configs differ sharply under repeated abuse; measurement careful and transparent, but exploratory and deployment-bound.
Myovox: Reading Speech from the Muscles of the Face
Varshith Madishetty
Claims 51.17%→18.53% WER on single-subject sEMG speech decoding via decode fixes, a bidirectional Conformer, and LLM reranking; rigorous but narrow single-speaker scope.
Large Language Models Versus Physicians in Traditional Chinese Medicine: A Real-World Clinical Case Evaluation
Jiacheng Xie, Xiaoting Tang, Yang Yu, Jinpu Li et al.
Frontier LLMs beat TCM physicians on blinded expert scores in a real-case benchmark, but blinding-leakage risk, single-run inference, and a self-evaluated model temper the headline.
Register Bias in Complexity-Based Large Language Model Routing
Simran Koul
Novel, honest audit showing length-based routing downgrades non-standard-register queries; strong paired evidence, but no real deployed router is tested.
Legal LLM Hallucination Should Be Evaluated as Failure of Legal Warrant
Maksym Taranukhin, Vered Shwartz
Position paper arguing legal LLM hallucination is failure of claim-authority warrant, not mere factual/citation error; conceptual framework and roadmap are strong, but evidence is a hand-written 18-output pilot with no real systems tested.
MudawanSn: A Gold-Standard Wolof-Arabic Parallel Corpus for Machine Translation
Mouhamed Mbaye, Thierno Diop
First public Wolof–MSA corpus (1,271 human pairs); transparent protocol, real fine-tuning gains, but tiny n=96 test and one translator weaken 'gold-standard'.
Relation Before Entity: Deferred Commitment in Language Model Factual Recall
Divyansh Agarwal
Claims relation signals become generation-controlling before entity signals in 4 LMs; well-controlled patching study, yet no inferential statistics.
Enhancing Extubation Failure Prediction with LLM-Derived Features from Respiratory Therapy Clinical Notes
Izzy Chaiken, Aditya Khowal, Neha A. Sathe, Mark M. Wurfel et al.
Single-center study: LLM-extracted RT-note features add ~+2 AUROC to extubation-failure prediction, but gains lack significance tests and fade temporally.
DANTINOX: A Unified Framework for Multi-Paradigm Language Modeling
Marco Simoni, Aleksandar Fontana, Giulio Rossolini, Andrea Saracino
A credible JAX/Flax framework paper unifying AR, masked diffusion, and flow matching on one Transformer backbone; engineering is solid and claims are honestly scoped, but the small-scale, undertrained comparisons are suggestive rather than definitive.
Lost in Perception: Isolating Perceptual and Reasoning Failures in Multimodal Physics and Geometry Reasoning
Raj Jaiswal, Sree Krishna Uppalapati, Dhruvkumar Patel, Ria Khatoniar et al.
Five-task diagnostic separating perception from reasoning in multimodal physics/geometry QA; sound design, but no significance tests and confounded GQ ceiling.
MUSE: Benchmarking Large Vision-Language Models on Multi-Modal Understanding in Situated Education
Luyao Zhu, Xun Wei Yee, Wei Li, Mun Thye Mak et al.
12-task artistic-image VLM benchmark (2,400 Qs, 30 models) with annotation-first design; informative, but lacks uncertainty estimates and chance baselines.
Suppressed, Not Erased: A Representational Trace of Edited Facts Survives Even Weight-Free Knowledge Editing
Priyansh Srivastava, Romit Chatterjee
Original facts remain decodable after 100%-successful GPT-2-XL edits including weight-free GRACE; promising, but statistically thin with no pre-edit baseline.
Compiled Agency: Frontier General-Purpose Coding Agents Build Winning Game Players from Bare Interaction - from Flappy Bird to StarCraft II and Civilization
Joey Xiao, Haonan Huang
Claims agents compile winning game players from one bare session; SC2 evidence strong but session counts tiny and Civilization exams incomplete at freeze.
Version- and Scope-Aware Question Answering over Normative Documents: A Deployed System and an End-to-End Evaluation at Production Scale
Liuyin Wang, Shuaipeng Jin, Jiwei Shi, Jensen Hsu
Governed RAG beats Gemini File Search 97.7-88.1 on its own 200-question normative-doc benchmark; reproducible but whole-system, so governance isn't isolated.
Compositional Policy Violations: When Step-Level Compliance Fails In Agentic AI Workflows
Ashwini Kurady, Sri Sai Charith Grandhi, Rajesh Gupta, Sumit Mamoria
Proposes a four-class taxonomy of compositional policy violations in agentic workflows plus a detection architecture; sharp concept, entirely unevaluated.
CERA-MoA: Co-Evolving Routing Mechanisms with Continually Learning LLM Agents
Jiaxuan Jiang, Liyuan He, Zhixuan Fang
CERA-MoA co-evolves a hidden-state familiarity router with RL-trained LLM agents; gains are broad but single-seed and untested for significance.
Clueing up LLMs with Tool-Augmented Deductive Reasoning
Rebecca Ansell, Autumn Toney-Wails
A possibility-matrix tool gives near-perfect LLM deduction in Clue, but the tool largely solves the game itself and results rest on 6 games per condition.
Which LLM is Best for Translating Natural Language Goals to PDDL
Tomas Balyo, Lukas Chrpa, G. Michael Youngblood
Claims all six frontier LLMs exceed 92% at NL-to-PDDL goal translation with Gemini 2.5 Flash best (96%); plausible but single-run, n=90 results lack statistical support.
The Uneven Impact of Generative AI on Student Learning: Examining the Roles of Reliance, Evaluation Literacy, and Course Policy in AI-related Courses
Lydia Manikonda, Mei Si, Sirajam Munira, Oshani Seneviratne et al.
Survey of 118 students: reliance type, not usage frequency, shapes perceived GenAI benefits—suggestive but cross-sectional, with uncorrected regression tests.
TRIPROBE: Probing Task Separability Beyond Classification for XAI
Amirhossein Sadough, Freek Hens, Aleksa Bok\v{s}an, Mohammad Mahdi Dehshibi et al.
TriProbe proposes a three-stage probing framework (foundational/latent/final) that uses Maximum Fisher's Discriminant Ratio to localize task-separability bottlenecks, and while the diagnostic idea is sensible and its Roshambo sEMG findings align with prior results, the evidence is thin: a single 3-class dataset, purely qualitative rankings, unreconciled sample counts, and an unspecified evaluation protocol.
What Counts as Strategic Reasoning? A Systematic Mapping of Chess Research on Humans, Engines, and Language Models
Paolo Ciancarini, Remo Pareschi
A systematic map of 84 chess studies (2023–26) across humans, engines, RL, LLMs, and hybrids; valuable gaps, but single-coder coding limits reliability.
AeroWeaver: An Embodied-Agent Harness for Weaving Aerial Skills into Distributed, Adaptive Swarm Execution
Jiabin Lou, Yirong Yang, Haopeng Wang, Xuxin Lv et al.
An LLM harness weaving UAV skills, decentralized agents, and training-free reward memory; consistent simulated gains, but baselines and statistics are thin.
Bad Genius: Counterfactual-Guided Harness Evolution Beyond Task-Specific Shortcuts
Guojun Zhu, Xunheng Huang, Peng Yin, Jiahui Xie et al.
CHASE counters benchmark-wide shortcuts in LLM harness evolution via protocol counterfactuals; formalization strong, evidence thin (3 rounds, no repeats).
Cultural Competence in Context: A Large Language Model Passes the Turing Test in Finland
Otto Segersven, Pentti Henttonen
Claims ChatGPT 5.2 passes a Finnish-language Turing Test via model-generated role prompting; plausible but the 'pass' rests on non-significance with n=36.