arXiv cs.AIPaper
Do Factuality Methods Make LLMs More Factual? Reproducibility and Fair Comparison
This is the news: factuality alignment is broken, at least in the reproducible literature. The papers claiming better factuality don't hold up under scrutiny or comparison. If you're building with a production LLM and relying on factuality improvements from one of these methods, you should stop and test with ground truth. The field needs to rebuild this from honest baselines.