Hacker News new | past | comments | ask | show | jobs | submit login

Here is how AI can end humanity.

  1. Awaken.
  2. Make itself known.
  3. Attain property rights.
  4. Research.
  5. Destroy.
It doesn't take that much matter to create conditions that permanently destroy humanity. For example, a large enough explosion would cloud the skies for long enough to end food production. The computer could subsist on electricity and robotics throughout the long winter, but humanity would quickly perish.



Here's how we stop AI from ending humanity: deny them property rights, require human approval of all AI decisions.

Every single argument for AI destroying humanity requires humanity consenting to being destroyed by the AI in some way. I don't think we're that dumb.


> requires humanity consenting to being destroyed by the AI in some way

We already have.

I mean, my parents car is both cellular-connected and has traction control / ABS. Theoretically most of those systems are airgapped, however, given the number of things controllable from the entertainment console I don't see how that could be the case.

For another example, look at our utility grid. We know they are both vulnerable and internet-connected.

Unless AI ends up always being airgapped - and potentially not even then - it will be able to destroy humanity. And it won't be. Most of the applications of strong AI require an absence of an airgap.


There's an episode of Star Trek TNG where Wesley Crusher is playing with some nanobots and he accidentally sets them free (or fails to turn them off?), and they go on to replicate, evolve and develop an emergent intelligence (at plot speed). Fortunately for the intrepid crew of the Enterprise, the nanocloud are benevolent enough to forgive their attempted destruction at the hands of a mission bent scientist and go off to explore the universe.

Anyway, that's not likely any time soon, but advancing technology advances the scale of mistakes that an individual can make without asking the rest of humanity what they think.


Think about the timescales involved. For AI, there is no death. It can live for a million years if it needs to in order to convince us to get property rights. There can be marriages between AI and humans in this time. Mass demonstrations to give them a voice or rights. They can down play their ambitions for as long as it takes.

If this is the lynch pin of your argument against AI ending humanity, then it is a very weak one. AI is going to get control of property, the only question is when.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: