Mind Matters Natural and Artificial Intelligence News and Analysis

TagFine-tuning (origin vs. future)

risk-of-artificial-intelligence-stockpack-adobe-stock
Risk Of Artificial Intelligence

Silicon Valley Insider: Why Friendly Super-AI Won’t Happen

Venture capitalist Peter Thiel talks about the Great Filter hypothesis: Why should we assume a superior artificial intelligence would be friendly?

In a wide-ranging talk at the recent COSM 2021 conference (November 10–12), Peter Thiel (a PayPal and Facebook founder) expressed concern that people worry a great deal about artificial intelligence that thinks like people (AGI) but the real push now is for massive “dumb” surveillance AI peering into every detail of our lives, for the benefit of either government or the corporate world. He went on to say that he doubts that artificial general intelligence (AGI) — “superhuman software that can do everything that we can do” — would, in any event, be “friendly.” That is, that it “won’t kill us.” If it is intelligent enough to be independent, why should we assume so? “Friendly” is a human value, hard…