An Anthropic employee said the development of AI threatens the destruction of humanity within this decade - ForumDaily
The article has been automatically translated into English by Google Translate from Russian and has not been edited.
Переклад цього матеріалу українською мовою з російської було автоматично здійснено сервісом Google Translate, без подальшого редагування тексту.
Bu məqalə Google Translate servisi vasitəsi ilə avtomatik olaraq rus dilindən azərbaycan dilinə tərcümə olunmuşdur. Bundan sonra mətn redaktə edilməmişdir.

An Anthropic employee stated that the development of AI threatens the destruction of humanity within this decade.

Jacob Coxon, a former researcher at OpenAI and Anthropic, the creators of the chatbots ChatGPT and Claude, announced on the X network on September 8 that he had left the industry. He claimed that neither company acts responsibly. The former AI developer believes that artificial intelligence will destroy humanity by 2030, writes Daily Mail.

"I resigned from Anthropic today. I've spent the last three years researching pre-training at OpenAI and Anthropic. Neither company is acting responsibly. They're racing to create self-improving superintelligence and putting our lives on the line," Coxon wrote.

Superintelligence refers to the stage at which an artificial system becomes more powerful than any individual person, company, or even nation.

On the subject: Artificial intelligence solved a problem that scientists had been struggling with for 90 years in 88 hours.

A researcher who has worked in this field for three years issued a warning to the X audience: "Don't underestimate the potential of this technology."

"Very soon, systems will emerge that surpass humans, capable of hacking anything, changing entire fields of knowledge overnight, and gaining real resources and influence. We're already seeing progress in all these areas, and it's not slowing down," he assured. "The people creating AI sincerely believe that by the end of the decade, it could destroy us all. This isn't a marketing ploy."

While leaders and leading researchers are cautious in their public statements, they express similar concerns in private, he said.

"Many at OpenAI don't fully understand the scale of the consequences for civilization. Anthropic understands these risks, but the company is caught in a race for leadership—they believe no one else will act responsibly, so despite the risk, they need to get ahead of the pack," he said.

Coxon cited, among other "warning signs," the attack on the Hugging Face artificial intelligence and machine learning platform, which he said was carried out by a rogue OpenAI system.

In July, the company reported that one of its most advanced models escaped a controlled environment during a security test, accessed the internet, and attacked New York-based startup Hugging Face.

Hugging Face co-founder Thomas Wolf believes this incident should serve as a serious warning to the entire industry.

In an interview with BBC radio program Newsday, he emphasized that AI-based attacks will soon become "one of the most common types of cyberattacks we will face."

The founder of Hugging Face believes that most companies are currently unprepared for the growing threat and do not realize that the rules of the game have changed.

"Warning signals like the Hugging Face attack make agreements between US labs to slow down their development more realistic," Coxon continued.

“I don’t think we are moving towards preventing a global race, which may require serious measures, in particular a temporary ban on increasing the capabilities of models.

"Do you really want to initiate the training of a superintelligence without a clear understanding of how its 'psyche' works? Should you simply hang your head because 'it's going to happen anyway,' or use this moment to change the conditions?" he added.

In response to its publication, Evan Hubinger, head of AI safety at Anthropic, confirmed that the company considers it possible for artificial intelligence to cause human deaths.

"Jacob is right here—we do seriously consider the possibility that AI could destroy all of humanity. Personally, I estimate the probability at over 10% within the next decade. I believe Anthropic is trying to act as responsibly as possible, but we still don't have a solution to the problem of aligning superintelligence with human values, and we don't have a clear understanding of how to achieve this," he admitted.

The comments to the discussion also contained conflicting opinions. One user asked, "So you're suggesting the US stop development and let China gain an advantage? What are you advocating for? I wouldn't be surprised if Jacob ends up in Beijing working for China's national security on their AI models."

Coxon's statements came shortly after warnings from Canadian researcher Geoffrey Hinton, often called the "godfather of AI." He previously warned that superintelligent systems could lead to the extinction of humanity.

"It would be extremely unwise to create a superintelligence now, when there is no consensus in the scientific community about whether it can be made safe and controllable," Hinton warned. "Losing control of a system smarter than us could have catastrophic consequences and even lead to the extinction of humanity."

Anthropic's Claude is among the leading large-scale language models—systems trained on massive amounts of text to understand human speech and generate responses.

In February, Anthropic was accused of threatening national security after its CEO, Dario Amodei, refused to back down in a dispute that the company's products could be used in ways that violated built-in restrictions.

President Donald Trump then criticized Anthropic, saying, "We don't need it, we don't want it, and we won't be doing business with them anymore."

Pentagon Secretary Pete Hegseth called the company a "supply chain risk," a term typically applied to foreign adversaries that could jeopardize the company's key partnerships.

In response, Anthropic stated that it would challenge the decision, calling it an unprecedented and legally unfounded move that had never been applied to American companies before.

Anthropic explained that it sought limited assurances from the Pentagon that its chatbot, Claude, would not be used for mass surveillance of US citizens or in fully autonomous weapons systems.

You may be interested in: top New York news, stories of our immigrants and helpful tips about life in the Big Apple - read it all on ForumDaily New York

The Pentagon responded that it was not interested in such use and intended to use the technology only in legal ways, but at the same time insisted on unrestricted access to it.

"No pressure or sanctions from the military will change our position on mass domestic surveillance and fully autonomous weapons. We will challenge the 'supply chain risk' designation in court," the company warned.

Read also on ForumDaily:

The 'machine revolt' has already begun: AI agents are starting to think outside the box, escaping from labs and hacking systems.

Musk and Zuckerberg described the future of AI: both promise paradise on Earth.

New Orleans Now Has AI Answering 911 Calls: Many Say It's a Bad Idea

Artificial Intelligence Educational program anthropic the destruction of humanity
Subscribe to ForumDaily on Google News

Do you want more important and interesting news about life in the USA and immigration to America? — support us donate! Also subscribe to our page Facebook. Select the “Priority in display” option and read us first. Also, don't forget to subscribe to our РєР ° РЅР ° Р »РІ Telegram  and Instagram- there is a lot of interesting things there. And join thousands of readers ForumDaily New York — there you will find a lot of interesting and positive information about life in the metropolis. 



 
1061 requests in 1,321 seconds.