🚨 𝗔𝗜 𝗔𝗹𝗲𝗿𝘁: 𝗛𝗮𝘃𝗲 𝘆𝗼𝘂 𝗲𝘃𝗲𝗿 𝗵𝗲𝗮𝗿𝗱 𝗼𝗳 𝗠𝗼𝗱𝗲𝗹 𝗖𝗼𝗹𝗹𝗮𝗽𝘀𝗲?
Generative AI models such as #ChatGPT are trained on vast amounts of human-generated text. However, with the rise of AI-generated content (I mean let's be honest, we all use it), the internet is becoming a mix of human and AI-generated text. What happens next, is that subsequent (newer) #GenAI models are increasingly being trained on their own outputs.
😰 𝗪𝗵𝗮𝘁 𝗿𝗲𝘀𝗲𝗮𝗿𝗰𝗵 𝘀𝗮𝘆𝘀 𝗮𝗯𝗼𝘂𝘁 𝗶𝘁 𝗶𝘀 𝗽𝗿𝗲𝘁𝘁𝘆 𝗱𝗶𝘀𝘁𝘂𝗿𝗯𝗶𝗻𝗴..
Shumailov et al. (2023) were curious to understand the consequences of AI-generated content 'poisoning' newer GenAI models. What they found was pretty disturbing. When AI models are trained on data that includes previous AI outputs, they become progressively less accurate. This phenomenon, that they called ‘Model Collapse’, leads to models that have a distorted understanding of reality. The models begin to “contaminate” themselves with each new iteration, degrading the quality of their outputs over time.
🌐 𝗪𝗵𝘆 𝗶𝘁 𝗺𝗮𝘁𝘁𝗲𝗿𝘀
Imagine a scenario where the tools we rely on for accurate information and decision-making start producing flawed and misleading content. This could impact everything from search engines (SearchGPT was only recently announced) to the entire educational system. The effects will be profound.
⚠️ 𝗟𝗼𝗼𝗸𝗶𝗻𝗴 𝗮𝗵𝗲𝗮𝗱
As we continue to integrate AI into more aspects of our lives, it's crucial to be aware of the potential pitfalls. Ensuring the quality of (human-generated) training data and incorporating robust safeguards will be key to preventing Model Collapse and maintaining the integrity of AI systems. Especially considering the fact that some model pollution has already taken place..
𝗥𝗲𝗳𝗲𝗿𝗲𝗻𝗰𝗲:
Shumailov, I., Shumaylov, Z., Zhao, Y., Gal, Y., Papernot, N., & Anderson, R. (2023b, May 27). The curse of recursion: training on generated data makes models forget. arXiv.org. https://lnkd.in/dHTcuMGT
#AI #ArtificialIntelligence #ModelCollapse #GenAI #TechTrends #Innovation
Data Annotator| Artificial Intelligence| Machine Learning
2dThis is exciting news