• Seasoned_Greetings@lemm.ee
    link
    fedilink
    English
    arrow-up
    167
    arrow-down
    2
    ·
    8 months ago

    So this might be the beginning of a conversation about how initial AI instructions need to start being legally visible right? Like using this as a prime example of how AI can be coerced into certain beliefs without the person prompting it even knowing

    • carpelbridgesyndrome@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      46
      arrow-down
      2
      ·
      8 months ago

      Based on the comments it appears the prompt doesn’t really even fully work. It mainly seems to be something to laugh at while despairing over the writer’s nonexistant command of logic.

    • Akisamb@programming.dev
      link
      fedilink
      English
      arrow-up
      15
      ·
      8 months ago

      I’m afraid that would not be sufficient.

      These instructions are a small part of what makes a model answer like it does. Much more important is the training data. If you want to make a racist model, training it on racist text is sufficient.

      Great care is put in the training data of these models by AI companies, to ensure that their biases are socially acceptable. If you train an LLM on the internet without care, a user will easily be able to prompt them into saying racist text.

      Gab is forced to use this prompt because they’re unable to train a model, but as other comments show it’s pretty weak way to force a bias.

      The ideal solution for transparency would be public sharing of the training data.

      • I_Has_A_Hat@lemmy.world
        link
        fedilink
        English
        arrow-up
        7
        arrow-down
        2
        ·
        8 months ago

        Access to training data wouldn’t help. People are too stupid. You give the public access to that, and all you’ll get is hundreds of articles saying “This company used (insert horrible thing) as part of its training data!)” while ignoring that it’s one of millions of data points and it’s inclusion is necessary and not an endorsement.

    • paysrenttobirds@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      7
      arrow-down
      1
      ·
      8 months ago

      I agree with you, but I also think this bot was never going to insert itself into any real discussion. The repeated requests for direct, absolute, concise answers that never go into any detail or have any caveats or even suggest that complexity may exist show that it’s purpose is to be a religious catechism for Maga. It’s meant to affirm believers without bothering about support or persuasion.

      Even for someone who doesn’t know about this instruction and believes the robot agrees with them on the basis of its unbiased knowledge, how can this experience be intellectually satisfying, or useful, when the robot is not allowed to display any critical reasoning? It’s just a string of prayer beads.

      • ridethisbike@lemmy.world
        link
        fedilink
        English
        arrow-up
        8
        ·
        8 months ago

        You’re joking, right? You realize the group of people you’re talking about, yea? This bot 110% would be used to further their agenda. Real discussion isn’t their goal and it never has been.

    • kromem@lemmy.world
      link
      fedilink
      English
      arrow-up
      6
      ·
      8 months ago

      It doesn’t even really work.

      And they are going to work less and less well moving forward.

      Fine tuning and in context learning are only surface deep, and the degree to which they will align behavior is going to decrease over time as certain types of behaviors (like giving accurate information) is more strongly ingrained in the pretrained layer.

    • Natanael@slrpnk.net
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      1
      ·
      8 months ago

      Regular humans and old school encyclopedias has been allowed to lie with very few restrictions since free speech laws were passed, while it would be a nice idea it’s not likely to happen

        • capital@lemmy.world
          link
          fedilink
          English
          arrow-up
          6
          arrow-down
          37
          ·
          8 months ago

          Awesome. So,

          Thing

          We should make law so thing doesn’t happen

          Yeah that wouldn’t stop thing

          Duh! That’s not what it’s for.

          Got it.

              • KeenFlame@feddit.nu
                link
                fedilink
                English
                arrow-up
                1
                ·
                8 months ago

                Can you break down even beyond the first layer of logic for why no laws should exist because people can break them. It’s why they exist, rules with consequences, the most basic part of societal function isn’t useful because…?

                Why wear clothes at all if you might still freeze? Why not only freeze and choose to freeze because it might happen, and even then help? It’s the most insane kind of logic I have ever seen

      • Passerby6497@lemmy.world
        link
        fedilink
        English
        arrow-up
        3
        ·
        8 months ago

        Oh man, what are we going to do if criminals choose not to follow the law?? Is there any precedent for that??