.jpeg)
Vitalik Buterin, co-founder of Ethereum, has proposed a radical approach to managing the risks associated with superintelligent AI. In a recent blog post, he suggested implementing a temporary "soft pause" on global computing power to allow humanity more time to prepare for potential threats posed by advanced AI systems.
Key Takeaways
-
Buterin proposes a "soft pause" on industrial-scale computing to mitigate risks from superintelligent AI.
-
The pause could reduce global computing power by up to 99% for one to two years.
-
This idea follows his advocacy for "defensive accelerationism" (d/acc), emphasizing caution in AI development.
Buterin's proposal comes in light of growing concerns among tech leaders and researchers regarding the rapid advancement of AI technologies. He believes that superintelligent AI could emerge within the next five years, and the consequences could be unpredictable and potentially harmful.
In his blog post, Buterin elaborated on the concept of a "soft pause," suggesting that it could serve as a last resort to slow down the development of risky AI systems. He emphasized that this pause would not be a complete halt but rather a significant reduction in available computing resources, allowing society to catch up and implement necessary safety measures.
The Concept of Defensive Accelerationism
-
Defensive Accelerationism (d/acc): A philosophy advocating for a cautious approach to technological advancement, particularly in AI.
-
Effective Accelerationism (e/acc): A contrasting viewpoint that promotes unrestricted technological progress without significant oversight.
Buterin's call for a soft pause is rooted in the belief that current regulatory frameworks may not be sufficient to address the potential dangers of superintelligent AI. He mentioned that he would only advocate for such a pause if convinced that stronger measures were necessary beyond existing liability rules, which would hold developers accountable for damages caused by AI systems.
Proposed Mechanisms for Implementation
To facilitate a soft pause, Buterin outlined several potential mechanisms:
-
Registration of AI Hardware: Identifying and registering locations of AI chips to monitor their usage.
-
Signature Requirement: Industrial-scale AI hardware could be designed to operate only if it receives weekly authorization from major international bodies, ensuring collective oversight.
-
Blockchain Verification: The authorization process could involve blockchain technology to ensure transparency and security, potentially requiring zero-knowledge proofs to validate signatures.
Buterin's vision for a soft pause reflects a growing recognition of the need for a more measured approach to AI development. As the technology continues to evolve at an unprecedented pace, the conversation around its implications for society becomes increasingly critical.