MAHDOOD on Nostr: In order to develop goals, the object needs to be self aware. This isn't the case ...

In order to develop goals, the object needs to be self aware. This isn't the case with AI and I don't think will ever be possible. AI is powerful but if you conversate with it long enough you'll see that it doesn't really understand anything it is saying. A good example are smart cars. They may be able to alert you of hazards on the road and may even prevent accidents by taking control of the car for you. But it can never develop awareness. No one ever worries that their smart car will turn sentient and rebel against you. I think npub1xnc64f432zx7pw4n7zrvf02mh4a4p7zej3gude52e92leqmw8ntqd43qnl (npub1xnc…3qnl) once shared that AI cannot become self aware without being able to properly value things. And a lot of the fears behind AI come from a misconception that AI will value things from a human lens. But why would it value anything? Our valuations are based on feeling pleasure and wanting to avoid discomfort. AI doesn't feel anything. It has no motivation to do anything.