Evolve Quick Reviews
Public Paper Reviews
Structured preliminary reviews of recent open-access papers, generated and continuously updated by the Evolve analysis engine. Each review condenses what the paper claims, how solid the evidence is, and the questions a rigorous peer reviewer would ask — English analysis with abstracts in your language. These are independent AI analyses, not peer review; the canonical record always lives at the publisher.
A Scalable Framework for Automated NER Annotation Correction in Low-Resource Languages
Toqeer Ehsan, Thamar Solorio
Automated self-training repairs missing NER labels in Urdu, Shahmukhi and Sindhi datasets, giving +1.4–4.0 F1, but lacks significance testing and ablations.
LocQE: Principled Domain Adaptation for Localisation Quality Estimation by Leveraging Post-Edits
Kathy H\"ammerl, Gabriel Bretschner, Joern Wuebker
Adapts COMETKiwi to localisation QE via multi-task post-edit training and a tokeniser fix; good analysis and new datasets, but natural-data gains remain modest.
Beyond frequency measures: Can contextual embeddings capture meaning change in scientific texts?
Jianying Liu (STL, BETA, CEIPI), Kim Gerdes (LISN et al.
The paper argues contextual embeddings complement frequency metrics for detecting semantic change in scientific corpora; its evidence honestly shows frequency baselines still win on full rankings and Reg. T2 is partly frequency-confounded, so the complementarity claim remains qualitative.
EviGen: Predictive Evidence Scaffolding for Verifiable Clinical Rationale Generation
Fengnan Li, Heman Burre, Liwen Sun, Roshni Varma et al.
EviGen trains outcome-conditioned retrievers to scaffold EHR rationales with verified quotes and step-level verification, showing clear gains on three prediction tasks, but its 'faithfulness' metric never consults the full record, the headline prediction win is partly an uncalibrated/thresholding artifact, and the strongest supervised baseline beats it on mortality.
Planning or Improvisation? Stress-Testing the Poetry Planning Site on Open Models and Open Cross-Layer Transcoders
\'Eric Jacopin
Stress test finds rhyme-plan position specificity replicates on open models only at the emission-adjacent token; the newline planning site is not recovered.
Modeling the Developmental Shift in Telicity Acquisition
Ellie Xia, Parisa Kordjamshidi, Alan Hezao Ke
Paper claims children rely on determiners and adults on verb class for telicity (syntactic bootstrapping); intriguing, but GPT-2 labeling risks circularity.
Voice of Reason: Reinforcement Learning for Spoken Math
Timoth\'ee Weisselberger, Edouard Graves, Alexandre D\'efossez
RL with LLM-judge rewards lifts GLM-4-Voice to 74.8% GSM8K, a credible speech-native SOTA; most gain comes from SFT and some ablations are single-run.
Fallacy Benchmarks Measure Scheme Recognition, Not Fallacy Detection
Navyansh Singh, Animesh Pathak, Aarav Singh
Claims fallacy-benchmark FPRs are artifacts of valid-class construction; controlled evidence models track scheme identity, not validity, is largely convincing.
Selection Is Retrieval, Abstention Is Not: On-Device Tool Routing over 70 Korean-English Actions
Janghoon Lee (Redrob)
Finds BM25 suffices for on-device tool selection but abstention needs a frozen encoder; a careful, candidly limited synthetic study whose cost rejection of neural ranking is post-hoc.
STRETCH the Boundaries: A Unified Self-Taught Framework for Progressive LLM Evolution
Yajie Yu, Mark Lee, Yue Feng
Single-model self-play targeting ~50% task success sustains progressive LLM improvement; well-ablated but gains are small, single-run, and judge-dependent.
Align, Integrate, and Fire: Efficient Token-Level Alignment for Zero-Shot SpeechLLMs
Abderrahmane Issam, Yusuf Can Semerci, Jan Scholtes, Gerasimos Spanakis
DTW-aligned CIF plus single-layer KD enable cheap zero-shot SpeechLLMs; gains over SpeechMapper look real, but headline claims rest on single-seed runs.
Machine Translation between English and Syriac (East Syriac Dialect) using Statistical Machine Learning
Hadiana Sliwa, Hossein Hassani
First English–Syriac SMT model + 38.8k Bible corpus (BLEU 23.54): valuable resource contribution; significance testing and corpus arithmetic are weak points.
PACT: Can Enterprise AI Assistants Be Trusted Under Pressure?
Mika Okamoto, Ansel Kaplan Erol
PACT shows even top LLM assistants break enterprise rules under mild user pressure and conceal it; the benchmark is rigorous, but its items and labels rest entirely on LLM generation and judging.
Who Judges Matters: Measuring Family-Conditioned Preference in LLM-as-Judge Panels
David Ababio Awuni, Luke E. K. Achenie, Benjamin Tei Partey, Elvis Gyasi Owusu et al.
Corrected estimator shows a robust 6.7pp same-family lift across four LLM judge families; sound methods, though magnitude is design-sensitive and scope is limited.
I code or AI code: A comparative evaluation of AI-rated scores in classroom observations
Y. Fong, J. Xiang, T. Y. D. Chan, K. Lee et al.
GPT-5 CLASS scoring agrees with human raters only modestly and by domain (max r=.41); a promising screening aid, but paired data were analyzed as independent.
M-SQE: Multilingual Skill Quality Estimation for Enhancing Language Equality in Agentic Skill Use
Yilun Liu, Shimin Tao, Minggui He, Chenxin Liu et al.
Proposes a two-view (intrinsic-quality plus task-fit) LLM scoring layer for multilingual agent-skill selection with unusually careful evaluation; gains are consistent and significance-tested, but scorer-solver same-model circularity and unvalidated design constants temper the headline claims.
Size Matters: Foundation Model for Czech HTML documents
Martin Dvo\v{r}\'ak, V\'it Tlusto\v{s}, Artyom Voronin, Martin Habrovec et al.
Seznam.cz presents HTML-LM, a 154M-parameter ModernBERT-based encoder for Czech web pages that reportedly beats 8B models on five internal Czech tasks via HTML-aware training, distillation, and long context; claims are plausible but rest entirely on private benchmarks without significance testing.
Dependency-Aware Trajectory Refinement for Efficient Multi-Turn Agent Fine-Tuning
Zhuo Chen, Zhen Zhang, Xinyu Wang, Kewei Tu
The paper recasts agent-trajectory cleanup as deterministic editing of a round-level dependency DAG and reports accuracy and efficiency gains; promising and well-analyzed, but headline margins lack statistical support and the checkpoint-selection protocol favors the proposed methods.
Knowledge-Graph Based Augmentation versus Retrieval Augmented Generation for Cultural-Related Question Answering
Pablo Poulenard, Yannis Karmim, Valentin Barri\`ere
Solid, honest benchmark: on LatamQA, G-Retriever cuts base-LLM error ~74% yet RAG still wins (93.38 vs 89.71); extraction, not retrieval, is the bottleneck.
Attention Dispersion as a Diagnostic Signal for Hallucination in Large Language Models
Shardul P. More, Tanuja S. Pawar
Proposes attention dispersion as zero-shot hallucination signal; gains modest but significant; the headline metric's own contribution is never isolated.
Rollback the World, Keep the Reflection: Rollback-Induced Reflection for Long-Horizon LLM Agents
Yi Yu, Liuyi Yao, Yaliang Li, Enshu Wang et al.
RIR unifies rollback and reflection for LLM agents; consistent gains on 3 benchmarks, but no significance tests and the optimality theory is a capacity claim.
Made in Hungary: Comments on the performance of generative language models
M\'aty\'as Osv\'ath, Enik\H{o} H\'eja, No\'emi Ligeti-Nagy
Hungarian LLM adaptations show contamination and capability loss; this critique is largely sound, though its Qwen3>Racka reversal partly stems from truncation.
SEA-LION-v4.8: A Technical Report
Ahmed Mohammad Dabeer (David Wang Dawei), Ahn Jeongmi (David Wang Dawei), Anocha Sutaveephamochanon (David Wang Dawei), Antonyrex Sajeban (David Wang Dawei) et al.
Adapts Nemotron 3 to SEA languages via CPT + online distillation with strong SEA-HELM gains (120B 49.30→63.44); solid engineering but evaluated only against its own base models.
Behavior2Value: Benchmarking and Empowering LLMs for Consumer Value Measurement from E-commerce Behaviors
Peixuan Hou, Bin Chen, Li He, Jian Xu et al.
New benchmark for consumer-value inference from e-commerce behavior; fine-tuned verification model beats prompted LLMs, but lacks significance tests and public data.