• jj4211@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      26 minutes ago

      In fact, if the models are ingesting this, they will get dumber because training on LLM output degrades things.

      • HertzDentalBar@lemmy.blahaj.zone
        link
        fedilink
        English
        arrow-up
        1
        ·
        20 minutes ago

        Exactly, I hope they hit a slop wall trying to train these things, replace all its original reference points with slop so it just cascades everywhere