If I rank them by a combination of likelihood and potential damage over the next 5–10 years, my top three are these:
AI in the hands of bad people. This worries me more than AI spontaneously “turning evil.” AI is rapidly lowering the skill and manpower needed for cyberattacks, fraud, surveillance and potentially biological or chemical threats. A relatively small group could eventually do things that once required a large intelligence service or technical organization. NIST already identifies AI-enabled cyberattacks as a serious risk, while frontier AI labs are explicitly testing for cyber and biological capabilities. (NIST)
Giving AI too much authority before we truly understand its weaknesses. Imagine AI agents controlling portions of the electrical grid, financial markets, military logistics, factories, hospitals or large computer networks. The danger doesn't require consciousness. An extremely capable system given the wrong objective, bad information or excessive access could make thousands of ...