• 0 Posts
  • 7 Comments
Joined 1 year ago
cake
Cake day: July 6th, 2023

help-circle

  • I can appreciate that contemporary neural networks are very different from organic intelligence, but consciousness is most definitely equivalent to a computer program. There are two things preventing us from reproducing it:

    1. We don’t know nearly enough about how the human mind (or any mind, really) actually works, and
    2. Our computers do not have the capacity to approximate consciousness with any meaningful degree of accuracy. Floating point representations of real numbers are not an issue (after all, you can always add more bits), but the sheer scale and complexity of the brain is a big one.

    Also, for what it’s worth, most organic neurons actually do use binary (“one bit”) activation, while artificial “neurons” use a real-valued activation function for a variety of reasons, the biggest two being that (a) training algorithms require differentiable models, and (b) binary activation functions do not yield a lot of information per neuron while requiring effectively the same amount of memory.