Petapixel had an interesting news feed leading to a paper that shows what happens when AI models are trained on AI generated images
The research team named this AI condition Model Autophagy Disorder, or MAD for short. Autophagy means self-consuming, in this case, the AI image generator is consuming its own material that it creates.
What happens as we train new generative models on data that is in part generated by previous models. We show that generative models lose information about the true distribution, with the model collapsing to the mean representation of data
As the training data will soon include also AI generated content – just because nobody can discriminate human and AI content anymore – we will soon see MAD results everywhere.