ArtificialIntelligence.io

The Signal

Everything that matters in AI, with our take.

Updated through the day. Every headline links straight to the source. The two lines underneath are ours.

arXiv cs.CLPaper

Training Advisors for LLM Agents from Task Outcomes

This is practically useful. Training a 4B critic that generalizes to larger models and different architectures, with 25+ point improvements on MuSiQue, shows that agent feedback can be factored into a reusable module. For teams building agents, this suggests an efficient path to debugging and iterating on reasoning without touching your base model. Production-ready approach.

arXiv cs.CLPaper

LiveMACE: Process-Aware Evaluation of LLM Agent Capabilities in Evolving Markets

The core finding is urgent: outcome and capability are decoupled. An agent that succeeds might do so for the wrong reasons, and this matters at scale. For builders shipping agents, this is a wake-up call to instrument and trace every decision path, not just measure wins. For researchers evaluating agents, outcomes alone are no longer acceptable. LiveMACEBench itself is the reusable artifact here.

arXiv cs.LGPaper

LESSER: Post-Training Data Selection with Output-Layer Gradients

This is a practical efficiency win for anyone doing large-scale SFT or RL on LLMs. Output-layer gradients as a proxy for full-parameter gradients is a clean trick that actually works. If you're building or fine-tuning models and doing data selection, implement this now; it cuts selection FLOP costs by an order of magnitude and you keep the quality.

arXiv cs.AIPaper

StudentBench: AI and human tutoring yield equivalent GRE learning gains

AI has crossed parity with expert human tutors on a standardized, measurable task. This matters because GRE tutoring is real revenue and hiring signal, and this is evidence that the model layer can replace expensive specialized labor. For investors: education technology just became a viable LLM product category. For builders: the bar is repeatable learning outcomes measured against humans, not benchmark points.