Iterative Degradation of Large Language Models Under Synthetic Data Feedback: A Systematic Review of Model Collapse Mechanisms and Mitigation Approaches
Summary — Executive Summary AI-generated data in training sets can induce gradual “degradation” of model performance. In this report we define degradation in terms of measurable metrics (perplexity, accuracy on benchma…
