arXiv cs.CLPaper
How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text
This is not theoretical. The web is poisoning itself and your pretraining data already contains it. For foundation model teams: you need active filtering now or you'll train into a local minimum. For everyone else: expect degradation in open-data model quality as the AI-generated fraction grows. The scaling-law cross-over point is near.