Can't really agree with that. During a time when I was working with ANNs, I would get together with a neuroscience researcher every couple of weeks to compare notes over tea. She helped me understand that they are really a lot different than brains.
The brain HAS NNs but it isn't just an NN. It's something else that uses a bunch of NNs like tools. (And those NNs are very different. They don't even do backprop.) The similarity between brains and llms is very partial and pretty vague.
Also we are not just brains. There is no strong reason to think that we are and lots of reasons to conclude that we are not. We also have hands, which is pretty unique and fundamental, but you don't assume that a mechanical grasping device is in the same category as you or alive in some special way.
The proof against mystical ideas about "AI" is model collapse. It proves they are purely mechanical. No more alive than an abacus. And abicus does math. And engine drives a car. AI just does work we are not used to machines doing. So it seems magical. But its not.
I'm not above getting swept away by the illusion, but I had two advantage.
1. I figured this out building simpler networks like embedding models before LLMs even landed
2. I saw even ML researchers getting swept up in the illusion even back then and have had like eight or nine years to think about it. All of this is much older than we think. Just the size is new.
It is literally a database. If you learn the mechanics of how it works, it is not mysterious at all. It's useful. It's neat. I like machines. But it is literally just a database. A compressed stochastic one. It feels like magic for the same reason a horoscope or ouija board does. Or gambling. It's randomness hijacking our sense of what is alive.
Life is order increasing in a physically entropic world. That's genuinely mystical. AI models collapse because they are closed mechanical, stochastic systems. They are no more alive than a toaster oven, and never will be. And you are. You are alive, aware, seeing beauty, grasping transcendent things, reasoning, choosing good or evil.
AAI can operationalize what humans put into them. On their own, it's just recycling and slowly losing the order we load into them.
Accept no imitations. It's a magic trick.
