• corroded@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    6 months ago

    What exactly is the use-case for a laptop or a tablet with ML acceleration? I can see the need in embedded devices; a self-driving car is a good example. Large-scale AI services are going to run in a datacenter. Who exactly is the target consumer for a laptop or tablet with an NPU?

    • iopq@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      6 months ago

      A person who wants to filter out noise from calls but doesn’t have an Nvidia GPU

      A person who wants to translate things, but doesn’t want to send work documents to the internet, etc.

      • Linkerbaan@lemmy.world
        link
        fedilink
        English
        arrow-up
        0
        ·
        edit-2
        6 months ago

        A person who wants to translate things, but doesn’t want to send work documents to the internet, etc.

        I’m sure Microsoft will respect their privacy…

        • iopq@lemmy.world
          link
          fedilink
          English
          arrow-up
          0
          ·
          6 months ago

          Who said anything about using Microsoft?

          The NPU is inside the machine whether you use windows or Linux

          • Linkerbaan@lemmy.world
            link
            fedilink
            English
            arrow-up
            0
            ·
            6 months ago

            It’s the Microsoft surface. And those NPU optimised networks from Microsoft aren’t available for Linux (yet)

            • iopq@lemmy.world
              link
              fedilink
              English
              arrow-up
              0
              ·
              6 months ago

              I have no interest in the networks themselves, I want the NPU to use with my programs