Microsoft CEO Satya Nadella stated on Sunday that the drive toward superintelligence—AI capable of outperforming humans in nearly all cognitive tasks—must prioritize “helping humanity” and remain under “human control.”
In an X post, Nadella advocated for wider AI adoption through a “frontier ecosystem” where both closed- and open-source models can “thrive” across nations, communities, and businesses.
“Any pursuit of superintelligence must be grounded in the principle that if the AI we build does not help humanity and stay under human control, it is not worth pursuing,” Nadella wrote. “We must also accelerate and diffuse AI benefits broadly across countries, communities, and companies, requiring a frontier ecosystem where both closed and open-source models thrive.”
Bill Gates Outlines the Stakes of the AI Era: ‘Greatest Equalizer… or Worst Source of Injustice’
Microsoft CEO Satya Nadella said Sunday that the pursuit of superintelligence must remain focused on “helping humanity” while staying under “human control.” (Fabrice COFFRINI / AFP via Getty Images)
He emphasized that organizations should build AI systems using their own data instead of relying on a single model provider.
“For firms, it is imperative that they retain full control over their unique and tacit knowledge,” Nadella wrote. “Every organization should be able to build its own continuous learning loop without becoming dependent on any single model provider, and have the ability to embed its own knowledge into models and weights they control.”
Nadella called for a measured approach to AI development, noting Microsoft supports concepts like “embedded evaluators.”
“In this context, we welcome the research, focus, and deliberate pacing needed to get alignment right as the design goal,” he said. “We also welcome ideas like ’embedded evaluators’ and the broader efforts to develop mechanisms to make this more than just talk.”
NVIDIA, Microsoft Urge US to Avoid Broad Restrictions on Open AI Models
Nadella also said advanced AI development should not be controlled by a handful of companies. (Craig T Fruchtman/Getty Images)
Nadella stated that advanced AI development should not be dominated by a few corporations.
“The key is that this cannot be controlled by a handful of entities but must have broad representation across the ecosystem, countries, and fields, including academia,” he said.
“This is the approach we are taking: broad access and choice at every layer of the AI stack; enterprise control of learning loops and models; and the ‘Code of Conduct’ that underlies our own first-party MAI models, which we will publish tomorrow for public consultation.”
His remarks come as debate intensifies over the rapid pace of AI development and the risks posed by increasingly capable systems.
Microsoft CEO Has a Warning About the AI Race
Anthropic CEO Dario Amodei said that there are “real dangers” associated with AI development. (Anna Moneymaker/Getty Images)
“I won’t lie to you—there are real dangers,” Anthropic CEO Dario Amodei said in an interview with CBS News. “And I think for too long the industry lied to people about the fact that this technology had risks.”
Last week, former Anthropic researcher Jacob Coxon warned on social media that Anthropic and OpenAI are “gambling with our lives” by pursuing self-improving superintelligence, adding that AI has a greater than 10% chance of “killing all humans” within “the next decade.”