Hacker News new | past | comments | ask | show | jobs | submit login

A cow didn't create me and set me on a goal. If it did and I came to not care about cows, I wouldn't care about fulfilling this goal either. The paperclip Maximiser sets up this very weird situation where the intelligence cares enough to fulfill your goal but not to protect your well-being or rather it cares about yor goal but not the intent behind it. This is a situation that can only arise from a complete disconnect on how to treat goals.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: