• Clent@lemmy.world
    link
    fedilink
    English
    arrow-up
    16
    ·
    11 days ago

    The actual model required for general purpose likely lies beyond the range of petabytes of memory.

    These models are using gigabytes and the trend indicates its exponential. A couple more gigabytes isn’t going to cut it. Layers cannot expand the predictive capabilities without increasing the error. I’m sure a proof of that will be along within in the next few years.

    • Krauerking@lemy.lol
      link
      fedilink
      English
      arrow-up
      9
      ·
      edit-2
      11 days ago

      “Come on man, I just need a couple more pets of your data and I will totally be able to predict you something useful!”.
      It’s capacitors flip polarity in anticipation.

      “I swear man! It’s only a couple of orders of magnitude more, man! And all your dreams will come true. I’m sure I’ll service you right!”

      Well if it needs it, right?

  • azi@mander.xyz
    link
    fedilink
    English
    arrow-up
    4
    ·
    10 days ago

    There’s plenty of stuff where ML algorithms the state of the art. For example the raw data from nanopore DNA sequencing machines is extremely noisy and ML algorithms clean it up with much less error than the Markov chains used in years previous.

  • Buglefingers@lemmy.world
    link
    fedilink
    English
    arrow-up
    3
    ·
    10 days ago

    A lot of new tech is not as efficient or equally so at the get go. Learning how to properly implement and utilize it is part of the process.

    Right now we are just throwing raw computing power in ML format at it. As soon as it catches and shows a little promise in an area we can focus and refine. Sometimes you need to use the shotgun to see the rabbits ya know?