
AI on Trial is a special episode of Human in the Loop, where we take a deep dive into Model Autophagy Disorder (MAD)βa growing risk in artificial intelligence systems. From feedback loops to synthetic data overload, we unpack how models trained on their own outputs begin to degrade in performance and reliability. With real-world examples, emerging research, and ethical implications, this episode explores what happens when AI starts learning from itselfβand what we can do to prevent it.
π‘ Whether you're an AI engineer, researcher, or just AI-curious, this episode gives you the tools to recognize, explain, and respond to MAD.
Featured Tool:
Try out the companion tool featured in the episode:
MADGuard β AI Explorer
A lightweight diagnostic app to visualize feedback loops, compare input sources, and score MAD risks.
Read the deeper explainer blog:π What Is Model Autophagy Disorder? β Human in Loop Blog
A plain-language breakdown of the research, risks, and terminology.
Other Detection Tools & Frameworks
DVC β Data Version Control
https://dvc.org/
Label Studio β Open-Source Data Labeling Tool
https://labelstud.io/
DetectGPT β Classify AI-generated Text
https://arxiv.org/abs/2301.11305
Grover β Neural Fake News Detector (Allen AI)
https://rowanzellers.com/grover/
References-
Alemohammad et al. (2023). Self-Consuming Generative Models Go MADPaper introducing MAD and simulating performance collapse in generative models.π arXiv:2307.01850
Yang et al. (2024). Model Autophagy Analysis to Explicate Self-consumptionBridges human-AI interaction with MAD dynamics.π arXiv:2402.11271
UCLA Livescu Initiative β Model Autophagy Disorder (MAD) PortalResearch hub on epistemic risk and feedback loop governance.π https://livescu.ucla.edu/model-autophagy-disorder/
Earth.com (2024) β Could Generative AI Go MAD and Wreck Internet Data?Reports on future data degradation and the "hall of mirrors" risk.π https://www.earth.com/news/could-generative-ai-go-mad-and-wreck-internet-data/
New York Times (2023) β Avianca Airline Lawsuit Involving ChatGPT BriefsLegal case where synthetic text led to real-world sanctions.π https://www.nytimes.com/2023/05/27/nyregion/avianca-airline-lawsuit-chatgpt.html