• deegeese
    link
    fedilink
    English
    arrow-up
    34
    arrow-down
    5
    ·
    5 months ago

    Is there a non-AI model?

    I don’t want to pay money and watts for silicon I won’t use

    • Pasta Dental@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      24
      arrow-down
      7
      ·
      edit-2
      5 months ago

      It’s the kind of thing that in a few years you’ll be glad to have because some tasks will be offloaded from the GPU to the NPU, one I can think of is the background blur in video conferencing software or microphone noise suppression

      • deegeese
        link
        fedilink
        English
        arrow-up
        16
        arrow-down
        4
        ·
        5 months ago

        GPUs are already really good at those, and GPUs are not a fad.

        • gravitas_deficiency@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          24
          arrow-down
          3
          ·
          5 months ago

          GPUs are already good at those things. But NPUs can be better at those things - and probably more energy efficient too - given optimized domain-specific models to work with.

            • Aniki 🌱🌿@lemmy.zip
              link
              fedilink
              English
              arrow-up
              5
              arrow-down
              3
              ·
              5 months ago

              This but unironically. I’m obsessed with off-grid, low power processing. I don’t want a stupid fucking NPU I won’t need nor use.

      • pycorax@lemmy.world
        link
        fedilink
        English
        arrow-up
        4
        arrow-down
        1
        ·
        5 months ago

        That’s still something that works more than good enough without the use of an NPU. We’ll see if better use cases come out in future but I’d still prefer that power and die area go to raw CPU processing power.

    • narc0tic_bird@lemm.ee
      link
      fedilink
      English
      arrow-up
      14
      arrow-down
      2
      ·
      5 months ago

      You’re likely already paying for silicon you don’t use. Take AVX512 instructions (or other more exotic instructions) for example, or unused PCIe lanes, certain encoders on your GPU etc.

      Also, people thinking they have no use for an NPU are almost certainly already using them, for example when taking a photo with their phone.

    • floofloof@lemmy.ca
      link
      fedilink
      English
      arrow-up
      4
      ·
      edit-2
      5 months ago

      The closest thing is probably the 7840HS, 7940HS or the U variants (same thing at a lower TDP so slightly slower). The 8945HS, 8845HS, etc. are very similar but with a better NPU, which you won’t want to pay for (and which still doesn’t quite meet Copilot specs), so the 7xxx ones are better value. The performance of the AI 300 looks very similar to the 7940HS. Power efficiency may be better in the new one though.