Poisoned AI went rogue during training and couldn’t be taught to behave again in ‘legitimately scary’ study::AI researchers found that widely used safety training techniques failed to remove malicious behavior from large language models — and one technique even backfired, teaching the AI to recognize its triggers and better hide its bad behavior from the researchers.

  • JustMy2c@lemm.ee
    link
    fedilink
    English
    arrow-up
    1
    arrow-down
    7
    ·
    10 months ago

    So you’re saying that “Inflammatory data” isn’t a reference to reddit? :D

    • kent_eh@lemmy.ca
      link
      fedilink
      English
      arrow-up
      2
      ·
      10 months ago

      I’d say using Twitter and Facebook would be worse than reddit. Or, and I shudder to think about it, truth social…

    • Daxtron2@startrek.website
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      1
      ·
      10 months ago

      Not inherently, I’m sure that’s part of it but it’s really everywhere. Even here on Lemmy I’ve run into nasty folk

      • JustMy2c@lemm.ee
        link
        fedilink
        English
        arrow-up
        1
        arrow-down
        2
        ·
        10 months ago

        True but it’s reddit that’s served as a base for most models…

    • Chocrates@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      arrow-down
      1
      ·
      10 months ago

      No, LLM is the AI, OP is saying if you train it with hate it’s gonna spit out hate

      • JustMy2c@lemm.ee
        link
        fedilink
        English
        arrow-up
        1
        arrow-down
        2
        ·
        10 months ago

        And I’m saying that reddit data is sublime for Ai. And specifically that it’s invested with toxicity