Aside from witty farewell statements on X, they haven’t elaborated on their concerns regarding OpenAI’s development methodology or the direction of AI in general.
That is, until earlier this week, when 165 pages of Leopold Aschenbrenner’s thoughts on the AI revolution were published. Aschenbrenner was a researcher who was fired from OpenAI in April.
Aschenbrenner served on the super alignment team at OpenAI, which was in charge of reducing AI risks.According to Aschenbrenner, he was fired by OpenAI for disclosing details regarding the organization’s preparedness for artificial general intelligence.
Aschenbrenner, for his part, claimed that the data he disclosed was “totally normal” and speculated that OpenAI might have been considering terminating him.
He was one of several employees who refused to sign a letter calling for CEO Sam Altman’s return after theboard briefly ousted Altman last year.
Aschenbrenner’s essay doesn’tappear to include sensitive details about OpenAI. Instead, as Aschenbrenner writes on the dedication page, it’s based on “publicly available information, my own ideas, general field knowledge, or SF gossip.”
Here’s ChatGPT’s 57-word summary of Aschenbrenner’s essay
ChatGPT distilled the essay into 57 words that outlined Aschenbrenner’s views on the evolution of AI.
“Leopold Aschenbrenner’s essay discusses the transformative potential of artificial general intelligence (AGI) and superintelligence, and forecasts significant advancements in AI technology in the near future. Aschenbrenner, formerly associated with OpenAI, outlines how the progression from current AI models like GPT-4 to AGI could occur much faster than anticipated, based on trends in computational power and algorithmic efficiency.”
ChatGPT then offered four key takeaways from Aschenbrenner’s essay
Rapid Progress in AI
“Aschenbrenner argues that AI development is accelerating at an unprecedented rate. He predicts that by 2027, AI models could reach the capabilities of human AI researchers and engineers, potentially leading to an intelligence explosion where AI surpasses human intelligence.”
Economic and Security Implications
“The essay highlights the immense economic and security implications of these advancements. Aschenbrenner points out that trillions of dollars are being invested into developing the infrastructure needed to support these AI systems, such as GPUs, data centers, and power generation. He also emphasizes the critical need for securing these technologies to prevent misuse, particularly by state actors like the CCP.”
Technical and Ethical Challenges
“Technical and Ethical Challenges: The essay discusses the significant challenges in controlling AI systems smarter than humans, referring to this as the “superalignment” problem. Managing this will be crucial to prevent catastrophic outcomes.”
Predictions and Societal Impact
“Aschenbrenner suggests that few people truly understand the scale of change that AI is about to bring. He discusses the potential for AI to reshape industries, enhance national security, and pose new ethical and governance challenges.”
Fewer than a few hundred people, mostly working in AI labs in San Francisco, are likely to possess “situational awareness” about the industry and, as Aschenbrenner noted, will therefore have the best insight into how AI will reshape the coming years. As one of these few hundred, Aschenbrenner appears to believe AI will play a crucial role in national security.
