How would the world be destroyed? Does an example work without handwaving about recursive self-improvement and an imperative to optimize extremely literally?
Can you give me a play by play of how a newly developed strong AI eradicates the human species quickly and thoroughly without us having any time to react?
EDIT: In summation, there have been several downvotes, but thus far no reply at all, let alone a convincing one.
Though I can't say for sure without going through it all again how many rely on smarter-than-human intelligence (achieved via FOOM or not), or how many explicitly end up literally eradicating the planet quickly and thoroughly.
Another thought experiment to consider instead (but it generalizes somewhat to AGI) is the Age of Em scenario, that is, human emulations become possible. The economic shift caused by this would be at least on the scale of the shift from forager -> farmer and from farmer -> industry. Post-transition doesn't mean (immediate) eradication for the old group, but close enough: they no longer control the world and their numbers as a percentage of the rest of the humans are vastly reduced. There's also a hierarchical control systems point I could throw in here that reaction and correction time at higher levels is going to be slower than that of lower levels, so any claims of "we would just squash it in a month" would highly depend on what level of control has to do the squashing. Some levels can't move that fast.
> Can you give me a play by play of how a newly developed strong AI eradicates the human species quickly and thoroughly without us having any time to react?
Is there any solid theory that these movie scenarios would play out in the real world?
Frankly, I don't want to even estimate the orders of magnitude of difficulty in seeing AGI come to fruition over ML, so I think you, I, and anybody else reading this has little to worry about.
How would the world be destroyed? Does an example work without handwaving about recursive self-improvement and an imperative to optimize extremely literally?
Can you give me a play by play of how a newly developed strong AI eradicates the human species quickly and thoroughly without us having any time to react?
EDIT: In summation, there have been several downvotes, but thus far no reply at all, let alone a convincing one.