Jure Repinc@lemmy.ml to AI@lemmy.mlEnglish · 2 years agoThe AI Feedback Loop: Researchers Warn Of "Model Collapse" As AI Trains on AI-Generated Contentventurebeat.comexternal-linkmessage-square1fedilinkarrow-up112arrow-down10cross-posted to: technology@lemmy.worldfuturology@lemmy.worldtechnology@lemmy.mltech@pawb.socialtechnology@beehaw.org
arrow-up112arrow-down1external-linkThe AI Feedback Loop: Researchers Warn Of "Model Collapse" As AI Trains on AI-Generated Contentventurebeat.comJure Repinc@lemmy.ml to AI@lemmy.mlEnglish · 2 years agomessage-square1fedilinkcross-posted to: technology@lemmy.worldfuturology@lemmy.worldtechnology@lemmy.mltech@pawb.socialtechnology@beehaw.org
minus-squareBehohippy@lemmy.worldlinkfedilinkEnglisharrow-up1·2 years agoAny data sets produced before 2022 will be very valuable compared to anything after. Maybe the only way we avoid this is to stick to training LLMs on older data and prompt inject anything newer, rather than training for it.
Any data sets produced before 2022 will be very valuable compared to anything after. Maybe the only way we avoid this is to stick to training LLMs on older data and prompt inject anything newer, rather than training for it.