Evolve Quick Reviews
Public Paper Reviews
Structured preliminary reviews of recent open-access papers, generated and continuously updated by the Evolve analysis engine. Each review condenses what the paper claims, how solid the evidence is, and the questions a rigorous peer reviewer would ask — English analysis with abstracts in your language. These are independent AI analyses, not peer review; the canonical record always lives at the publisher.
Benchmark Radar: A Living Database and Search Engine for AI Benchmarks and Evaluation
Koutian Wu, Junjie Zhou, Ergan Shang, Jiayu Wang et al.
A living search engine over 1,283 AI benchmark records with a rare full-catalog census and strong provenance, yet its own retrieval quality goes unevaluated.
How AI Coders Discuss, Disagree, and Reach Consensus: Challenges and Opportunities for LLM-Based Qualitative Coding
Jeongyeon Kim, John Mitchell
Cross-dataset HCI study claims intense AI-coder debates signal higher coding accuracy; solid but single-model, correlational evidence, no CIs shown.
QTrans: A Quantum Transformer for Sentiment Classification
Ren-Xin Zhao, Xinjie Huang, Yahong Liu, Maoyu Ye et al.
QTrans adds 4-qubit quantum attention to a tiny Transformer, beating classical baselines on 3 sentiment sets, but single-seed results cap the claim.
Overview of the NLPCC 2026 Shared Task 11: Agent-Based Experiment Reproduction from Scientific Papers
Hanhua Hong, Yizhi Li, Luu Gia Huy, Jian Yang et al.
NLPCC 2026 task overview: process-traced repro benchmark (150 papers); best system 49.6%; rubric-validation correlation is same-judge, limiting its force.
Beyond Benchmarks: Using VLMs to Reveal Systematic Classification Failures Under Real World Conditions
Dieuwertje Alblas, Alma M. Liezenga, Jan Erik van Woerden, Fedor Taggenbrock et al.
VLM error-slice pipeline recovers injected perturbations on dogs but degrades on military data—an honest, preliminary, baseline-free V&V feasibility study.
LILA: Calibration-Free Structured Pruning of Large Language Models via Latent Spectral Geometry
Sankar Behera, Dhruv Singh, Anshika Agnihotri, Raj Kumar Choudhary et al.
Calibration-free KS-spectral pruning beats PruneNet/SliceGPT zero-shot; promising, but inconsistent baselines and a weak KS-accuracy correlation temper claims.
KuaiRP Series Role-playing Models Technical Report
Yipeng Wang, Ziwei Zhang, Jiahui Zhang, Qi Gan et al.
KuaiRP restores BFCL to base after domain RP SFT/RL via two-stage on-policy distillation; coherent, but eval is self-built with reward-eval circularity.
HERALD: High-Fidelity Exemplar Retrieval with Adaptive Landmark Distillation for Heterophily-Aware Graph Condensation
Sujan Chakraborty, Priyanka Saha, Saptarshi Bej
Heterophily-adaptive BONSAI variant; solid tight-budget gains on heterophilic graphs, but ablations show feature selection, not adaptive scoring, drives them.
Rubric-Aligned Disentangled Evaluation of Human Simultaneous Interpreting
Ziyu Zhang, Satoshi Nakamura
基于 1,101 个片段的评分标准标注 SI 语料库构建；双头 LoRA COMET-KIWI 达到 r=0.388 LQ。虽然合理，但测试集较小；LLM 基线缺乏模型标识。
Adaptive Conformal Redistribution for Inter-class Transitional Uncertainty in Medical Image Classification
Saibal Ghosh, Samarup Bhattacharya, Sanjoy Kumar Saha, Umapada Pal et al.
AdaConRed converts ambiguous conformal sets into single labels, lifting malignant sensitivity on OSCC/ISIC; promising, but gains lack statistical testing.
Bidirectional Multimodal Fusion of Sky Images and Time-Series for Solar Forecasting with Large Language Models
Ken Chen, Maneesha Perera, Wei Wang, Sachith Seneviratne et al.
SolCloudLLM adds sky-image fusion to a frozen LLM forecaster; solid MSE and few-shot gains on SIRTA/SKIPP'D, but single-run and no multimodal baselines.
From Repetition to Recognition: Inductive Discovery of Disinformation Narratives
Max Upravitelev, Veronika Solopova, Jing Yang, Charlott Jakob et al.
Proposes closed-to-open-world eval for narrative discovery; solid framework and sweeps, but discovery claims rest on two co-author annotators and single runs.
How Wrong Can a Good Predictor Be? Diverging Updates with Vanishing Predictive KL
Qifu Wen, Shuaijun Liu, Zihan Zhou, Xi Zeng et al.
Proves fixed-K diverging Bayesian vs radial updates can coexist with vanishing predictive KL in Gaussian HMMs; rigorous proofs, honestly bounded scope.
Phase-Decoupled, Model-Calibrated Power Control for Disaggregated LLM Serving
Jae Gon Kim, Donghoon Yoo, Hanyul Ryu, Sungho Ha et al.
Claims per-lane calibrated power control beats NVIDIA Max-Q 1.5-3.4x on tokens/J at lower latency on B200 MoE serving; credible and honest, but small-N.
Can LLMs Normalize Databases? A Benchmark and Multi-Agent Framework for Schema Normalization
Dong-Jae Koh, Huisu Kim, SeongHwan Yoon, Lasse M. Jantsch et al.
DNBENCH claims LLMs fail schema normalization; MARS adds 82% relative gain — well-instrumented and candid, but single-run, quantized-only evidence.
When does a spectral prior help graph learning? Connectivity-loss estimation under road-network disruptions
Van-Truong Le
Honest, careful study of GNN residuals over a Fiedler prior for road connectivity loss; gains are regime-dependent, and 13 purposive OSM areas cap generality.
Autonomous Chemical Mechanistic Discovery through Agentic Reasoning and Validation
Dong Li, Sixuan Mi, Zihao Ye, Huan Xiong et al.
An agentic GPT-5+Gaussian-expert loop for autonomous mechanism discovery; three convincing case studies, but n=3 and LLM-judged evaluation temper the claims.
A Fragility Spectrum for Recursive Language-Model Training
Yangze Liu, Zhongyi Han
Finds checkpoint-specific collapse fragility (5x u4 spread, seed-stable ordering) via careful 13-model study; tiny 1-4B corpus regime limits reach.
Certified Safety Curation: Distribution-Free Guarantees for Safe Offline Reinforcement Learning
Adam Haroon, Cody Fleming
Certified training-set curation for safe offline RL with validated (α,δ) bounds; rigorous and honest, but certificates fire rarely and supervision is synthetic.
Human Agreement and Return Association Are Not Interchangeable Criteria
AS Aravinthakshan, Laven Srivastava, Harsh Nandwani
Claims benchmark agreement ≠ predictive validity; careful, honest dual-validity study, though rankings rest on 5 instruments and one gold annotator.
The Oligarch Barely Steers Model Collapse in Multi-Model Ecosystems
Yangze Liu, Zhongyi Han
Claims market concentration barely changes model collapse's pace or endpoint in 1–4B ecosystems; a careful null result, limited by scale and 5 generations.
terms.txt: A Consent and Compensation Protocol for Agentic Web Access
Rajarshi Chowdhury
Specifies terms.txt for per-purpose machine-access terms with a signed origin exchange; well-reasoned and honest, but validated by loopback microbenchmarks.
DRG-MAPPO: Hierarchical Dynamic Role-Graph Multi-Agent Reinforcement Learning for Cooperative Air Combat
Junlin Liu, Chengwei Li, Yang Gao, Hui Chang et al.
Claims an 87% win rate for graph+role-hierarchical MAPPO in 2v2 BVR air combat; promising integration but CTDE inconsistency and no code or error bars.
Beyond Visual Quality: Evaluating Physical Consistency under Ego-Motion with EgoGenEval
Yilin Long, Chenming Zhu, Zitang Gou, Jingli Lin et al.
Credible dual-axis CMG/SSP benchmark for ego-motion consistency; strong human validation, but headline chain-degradation contrast is aggregation-sensitive.