• casmael@lemm.ee
    link
    fedilink
    arrow-up
    38
    ·
    6 months ago

    Why would you develop this technology I simply don’t understand. All involved should be sent to jail. What the fuck.

    • Even_Adder@lemmy.dbzer0.com
      link
      fedilink
      English
      arrow-up
      27
      ·
      6 months ago

      They worded the headline that way to scare you into that reaction. They’re only interested in telling you about the negative uses because that drives engagement.

    • some_guy@lemmy.sdf.org
      link
      fedilink
      arrow-up
      18
      ·
      6 months ago

      They mentioned one potential use that I thought has value and that I hadn’t considered. For video conferencing, this could transmit data without sending video and greatly reduce the amount of bandwidth needed by rendering people’s faces locally. I don’t think that outweighs the massive harms this technology will unleash. But at least there was some use that would be legit and beneficial.

      I’m someone who has a moral compass and I don’t like that scammers will abuse this shit so I hate it. But there’s no keeping it locked away. It’s here to stay. I hate the future / now.

      • flora_explora@beehaw.org
        link
        fedilink
        arrow-up
        3
        ·
        6 months ago

        Wouldn’t you then have to run the AI locally on a machine (which probably draws a lot of power and memory) or use it via cloud (which depends on bandwidth just like a video call). I don’t really see where this technology could actually be useful. Sure, if it is only a minor computation just like if you take a picture/video with any modern smartphone. But computing an entire face and voice seems much more complicated than that and not really feasible for the usual home device.

        • Markaos@lemmy.one
          link
          fedilink
          arrow-up
          3
          ·
          6 months ago

          Yeah, it’s not practical right now, but in 10 years? Who knows, we might finally have some built-in AI accelerator capable of running big neural networks on consumer CPUs by then (we do have AI accelerators in a large chunk of current CPUs, but they’re not up to the task yet). The system memory should also go up now that memory-hungry AI is inching closer to mainstream use.

          Sure, Internet bandwidth will also increase, meaning this compression will be less important, but on the other hand, it’s not like we’ve stopped improving video codecs after h.264 because it was good enough - there are better codecs now even though we have the resources to handle bigger h.264 videos.

          The technology doesn’t have to be useful right now - for example, neural networks capable of learning have been studied since the 1940s, even though there would be no way to run them for many decades, and it would take even longer to run them in a useful capacity. But now that we have the technology to do so, they enjoy rapid progress building on top of that original foundation.

        • barsoap@lemm.ee
          link
          fedilink
          arrow-up
          2
          ·
          edit-2
          6 months ago

          A model that can only generate frontal to profile views of heads would be quite small, I can totally see that kind of thing running on current consumer GPUs, in real time. Near real time is already possible with SDXL-based models with some speedup tricks applied as long as you have a mid-range gaming GPU and those models are significantly more general. It’s not like the model would need to generate spaghetti and sports cars alongside with the head.

      • Lem Jukes@lemm.ee
        link
        fedilink
        arrow-up
        2
        ·
        6 months ago

        Also I would argue sending the actual video of what is happening in front of the camera is kind of the entire point of having a video call. I don’t see any utility in having a simulated face to face interaction where neither of you is even looking at an actual image of the other person.

    • henfredemars@infosec.pub
      link
      fedilink
      English
      arrow-up
      11
      ·
      6 months ago

      You can’t simply not develop a technology. Progress is going to move forward. If they don’t do it, somebody else is going to figure out how. The tools are out there. The math works. Better researchers to do it now and scare us into finding solutions than criminals to develop it first.

    • notfromhere@lemmy.ml
      link
      fedilink
      arrow-up
      7
      ·
      6 months ago

      Other than the obvious malicious uses of this technology, it could be great for multimedia, great for creative control for cast, great for virtual meetings to always look “your best” (as determined by each individual, e.g. clean-cut pristine, and/or preferred gender, and/or favorite anime, etc.). There are also use cases to hear letters spoken by a lost loved one, or replace the Three Stooges with politicians. Tons of “safe” use cases that I am looking forward to.

      • henfredemars@infosec.pub
        link
        fedilink
        English
        arrow-up
        4
        ·
        6 months ago

        This is a really positive take. I would love to create such an AI of myself in my likeness so that if one day I come to pass before my wife, she could enjoy having that comfort. I imagine it speaking like: while I’m not your husband, here’s what I think he would’ve said.

        Deep faking myself so I don’t have to use my camera in meetings? I would pay for that feature.

      • floofloof@lemmy.ca
        link
        fedilink
        English
        arrow-up
        3
        ·
        edit-2
        6 months ago

        I’m not convinced any of these uses are actually beneficial. They mostly range from creepy to pointless.

        • notfromhere@lemmy.ml
          link
          fedilink
          arrow-up
          1
          ·
          6 months ago

          Entertainment might be pointless to some. I dream of having an on-demand Netflix that will generate whatever type of content I can imagine on demand, or better yet already know my preferences and all I have to do is tell it my mood and it will start playing something I would like.

          • floofloof@lemmy.ca
            link
            fedilink
            English
            arrow-up
            3
            ·
            edit-2
            6 months ago

            A difference in goals, I guess. Having programs generated just to pander to my existing tastes sounds horrible to me. I want to be challenged and surprised and have my tastes tested and changed in unpredictable ways. I also want to watch stuff that’s written by humans and acted by humans, because there’s a sense of shared life there that there isn’t in an AI-generated video.

            • Pete Hahnloser@beehaw.org
              link
              fedilink
              arrow-up
              4
              ·
              edit-2
              6 months ago

              It’s also then just one step removed from refusing to accept any friends or romantic partners who don’t do exactly what you want at all times because life is supposed to be tailored to you.

              • notfromhere@lemmy.ml
                link
                fedilink
                arrow-up
                1
                ·
                edit-2
                6 months ago

                Actually I’m not sold on that logic. You could say that about anything at that point. The food that you order, the school you attend, your shoes.

    • meseek #2982@lemmy.ca
      link
      fedilink
      arrow-up
      5
      ·
      6 months ago

      Because bags of money. And MS is a hyper toxic entity that’s been siphoning the data of every Windows user for decades now. That company is basically IBM during WW2.

    • PM_ME_VINTAGE_30S [he/him]@lemmy.sdf.org
      link
      fedilink
      English
      arrow-up
      3
      ·
      6 months ago

      Would be great for me and others who have trouble with body language. I could deepfake a version of myself with neurotypical body language and offload the effort of “acting normal” to the AI for interviews and video calls. Genuinely I’m super pumped for this.

    • CanadaPlus@lemmy.sdf.org
      link
      fedilink
      arrow-up
      1
      ·
      6 months ago

      They’re also releasing a detector, for what it’s worth.

      Yeah, this one seems like it will have more negative applications than positive. Usually you’ll have a lot more content from someone you want to copy for non-deceptive reasons. It’s inevitable all video will be easily fake-able one day soon, but why hasten it?