RT
@emollick: So many critics have chosen to adopt a set of beliefs that AI is just going to go away - sometimes it is an argument that it is all fake to begin with, sometimes it is “model collapse” etc.
We need good criticism & policy in this space, and that requires recognizing where we are
I've been skeptical of "model collapse" myself in the past (synthetic data clearly works great when you train on it deliberately) but I hadn't realized that the original model collapse paper was based on the tiny OPT-125M model from 2022 -
Simon WillisonDr. Malini Nair 🇺🇦 🇮🇳
WMO Scientists on Telegram by
@WMOScientistsA
@grttme project - Other backups:
@Hallotme