• Ekky
      link
      fedilink
      English
      arrow-up
      4
      ·
      3 months ago

      You don’t have to sanitize the weights, you have to sanitize the data you use to get the weights. Two very different things, and while I agree that sanitizing a LLM after training is close to impossible, sanitizing the data you give it is much, much easier.