Existential Risk
Many artificial intelligence researchers warn that AI could potentially lead to the end of humanity.
Highly intelligent things are extremely powerful. If we build a machine that is far more intelligent than humans, we must ensure that it wants the same things we do. However, this has proven to be extremely difficult. This is known as the alignment problem.
If we fail to solve it in time, we could end up with superintelligent machines that do not care about our well-being. We would be introducing a new species to the planet that could surpass us in intelligence and outcompete us.
Why Is a Pause Necessary?
Artificial intelligence is advancing at an unprecedented pace. The most powerful systems are being built by a small number of companies and countries, and the race for technological supremacy can put pressure to prioritize development over safety.
Sign the Petition