The Signal

Everything that matters in AI, with our take.

Updated through the day. Every headline links straight to the source. The two lines underneath are ours.

agents162 research126 infra70 claude69 capital49 labs43 culture39 safety38 openai33 regulation30 anthropic24 security24 reasoning19 evaluation18 robotics13 frontier-models12

arXiv cs.LGPaper17h ago

When the KV Cache Is Slower Than the GPU: Scaling Remote KV Tiers for Context-Parallel Prefill

This is infrastructure troubleshooting with real teeth. A remote KV cache sounds efficient but the paper shows it can wreck p99 latency: 17.3s instead of 3.96s. The cost model (hit pays off only above B* = sR threshold, plus fixed per-hit engine cost) gives operators a way to decide when remote tiers make sense. If you're scaling long-context serving across multiple engines, this reframes the cache strategy conversation.

infra serving llms latency kv-cache

arXiv cs.AIPaper3d ago

Do Factuality Methods Make LLMs More Factual? Reproducibility and Fair Comparison

This is the news: factuality alignment is broken, at least in the reproducible literature. The papers claiming better factuality don't hold up under scrutiny or comparison. If you're building with a production LLM and relying on factuality improvements from one of these methods, you should stop and test with ground truth. The field needs to rebuild this from honest baselines.

research llms factuality reproducibility

arXiv cs.AIPaper3d ago

How Well Do LLMs Perform in Peer Review? Evidence from Finance and Accounting

This is actionable: LLMs can audit the technical soundness of research but can't judge whether it matters. Finance and accounting journals, and anyone using AI for peer review, now have a clear limitation to work with. The implication is that human judgment on novelty remains irreplaceable, and automation should funnel, not replace, the full review cycle.

research llms peer-review evaluation