{"id":12554,"date":"2026-06-05T17:31:47","date_gmt":"2026-06-05T17:31:47","guid":{"rendered":"https:\/\/siliconvalleymovingpost.com\/?p=12554"},"modified":"2026-06-05T17:31:47","modified_gmt":"2026-06-05T17:31:47","slug":"anthropic-urges-a-way-to-pause-ai-development-as-risks-grow-with-the-tech-advances","status":"publish","type":"post","link":"https:\/\/siliconvalleymovingpost.com\/?p=12554","title":{"rendered":"Anthropic urges a way to pause AI development as risks grow with the tech advances"},"content":{"rendered":"
\n

By KELVIN CHAN and MATT O\u2019BRIEN, AP Business Writers<\/strong><\/p>\n

Anthropic is proposing that the world\u2019s top\u00a0artificial intelligence companies\u00a0come up with a coordinated way to pause development of advanced AI systems, warning the technology is improving so quickly there\u2019s a risk humans would\u00a0lose control.<\/p>\n

Read more A federal judge strikes down Trump administration immigration policy affecting 39 countries<\/a><\/p>\n

The company behind the Claude chatbot said in a blog post Thursday that as cutting-edge AI gets increasingly faster at carrying out tasks, \u201cit would be good for the world to have the option to slow or temporarily pause\u201d its development.<\/p>\n

Anthropic\u00a0said its internal research institute plans to explore the issue in collaboration with others and \u201ctake actions\u201d to help build the systems for a credible slowdown or pause, without being more specific.<\/p>\n

Anthropic rival OpenAI argued for a different approach in a report published Wednesday, saying that \u201cdemocratic governments \u2014 not private companies acting alone \u2014 must ultimately determine the rules, safeguards, and accountability mechanisms.\u201d<\/p>\n

\u201cOur view is that decisions about the pace of AI innovation should not be left to any one lab, company, or special interest group,\u201d it said.<\/p>\n

AI models are getting faster, with rapid increases in how quickly they can carry out software tasks like coding on their own, Anthropic said in its post. Based on current trends and given enough computing power, an AI system could be able to design and develop its own successor, in what is known as \u201crecursive self-improvement.\u201d<\/p>\n

Self-building AI would be a major technological milestone that would bring benefits in science, healthcare and other areas, Anthropic said, but it \u201calso might increase the risks of humans losing control over AI systems.\u201d<\/p>\n

\n<\/div>\n

Some tech industry figures have long warned of such a scenario.<\/p>\n

Anthropic\u2019s post comes after a different warning this week from a team of researchers at the University of Toronto who showed how AI tools could be used to create a new kind of AI \u201cworm\u201d that adapts its hacking strategy as it spreads from device to device and takes over a vast computing network.<\/p>\n

\u201cI think it\u2019s really important that people understand that it\u2019s not just the biggest, most powerful language models that pose the security concerns,\u201d lead researcher Nicolas Papernot said in an interview.<\/p>\n

Read more Removal of toxic chemicals from GKN Aerospace in Garden Grove is delayed<\/a><\/p>\n

The authors of\u00a0the Anthropic post, company co-founder Jack Clark and Marina Favaro, head of the research institute, said the pause would be used to enable \u201csocietal structures and alignment research\u201d to keep up with AI advances. Alignment is industry shorthand for making sure the technology matches human values and intentions.<\/p>\n

\n<\/div>\n

The proposed coordination would let advanced AI labs verify that global rivals have actually stopped or slowed their work, \u201cand that a bad actor could not use the auspices of a coordinated slowdown to jump ahead in secret.\u201d<\/p>\n

The company said a coordinated global mechanism is needed because without it a slowdown in AI development could let the \u201cleast cautious\u201d players catch up and add to pressure on companies and governments as they make tough choices about AI safety.<\/p>\n

Anthropic\u2019s post comes as the company and ChatGPT-maker OpenAI race to sell shares on the stock market, in an IPO that could value Anthropic at nearly a trillion dollars.<\/p>\n

Papernot notified Canadian cybersecurity authorities prior to releasing the report, which shows how researchers developed the worm in a laboratory by using an \u201copen-source\u201d AI tool that is easy for software developers to cheaply access and modify.<\/p>\n

\u201cIn the past, cyber attackers would focus on targets that are very high value,\u201d he said. \u201cBanking systems, hospitals, electricity grids, water treatment systems, schools.\u201d<\/p>\n

Papernot agreed that there should be more collaboration between companies, government agencies and academic researchers to develop countermeasures as AI-powered hacking tools supercharge the search for computer vulnerabilities.<\/p>\n

\u201cThat old laptop you have in your basement that you don\u2019t check on regularly doesn\u2019t seem like a very high-value target, but It can be used as a launch pad to attack these higher-value targets,\u201d he said. \u201cAnything connected to the internet is now at risk because of how low the cost has become to mount these cyberattacks.\u201d<\/p>\n

Read more Rent dips in most of Southern California. Which cities have biggest drops?<\/a><\/p>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

Anthropic is proposing that top AI companies coordinate a way to pause the development of advanced AI systems. The company behind the Claude chatbot says the technology is improving so quickly that there’s a risk humans could lose control.<\/p>\n","protected":false},"author":1,"featured_media":12553,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[23],"tags":[],"class_list":["post-12554","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-technology"],"yoast_head":"\nAnthropic urges a way to pause AI development as risks grow with the tech advances - Silicon Valley Moving Post<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/siliconvalleymovingpost.com\/?p=12554\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Anthropic urges a way to pause AI development as risks grow with the tech advances - Silicon Valley Moving Post\" \/>\n<meta property=\"og:description\" content=\"Anthropic is proposing that top AI companies coordinate a way to pause the development of advanced AI systems. The company behind the Claude chatbot says the technology is improving so quickly that there's a risk humans could lose control.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/siliconvalleymovingpost.com\/?p=12554\" \/>\n<meta property=\"og:site_name\" content=\"Silicon Valley Moving Post\" \/>\n<meta property=\"article:published_time\" content=\"2026-06-05T17:31:47+00:00\" \/>\n<meta name=\"author\" content=\"admin\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"admin\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/siliconvalleymovingpost.com\\\/?p=12554#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/siliconvalleymovingpost.com\\\/?p=12554\"},\"author\":{\"name\":\"admin\",\"@id\":\"https:\\\/\\\/siliconvalleymovingpost.com\\\/#\\\/schema\\\/person\\\/636e2e5a10a21cf87fe6eb5951e8a6b7\"},\"headline\":\"Anthropic urges a way to pause AI development as risks grow with the tech advances\",\"datePublished\":\"2026-06-05T17:31:47+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/siliconvalleymovingpost.com\\\/?p=12554\"},\"wordCount\":735,\"commentCount\":0,\"image\":{\"@id\":\"https:\\\/\\\/siliconvalleymovingpost.com\\\/?p=12554#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/siliconvalleymovingpost.com\\\/wp-content\\\/uploads\\\/2026\\\/06\\\/02fc9b0f2ae5482c94e624742994bd94.webp\",\"articleSection\":[\"Technology\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/siliconvalleymovingpost.com\\\/?p=12554#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/siliconvalleymovingpost.com\\\/?p=12554\",\"url\":\"https:\\\/\\\/siliconvalleymovingpost.com\\\/?p=12554\",\"name\":\"Anthropic urges a way to pause AI development as risks grow with the tech advances - Silicon Valley Moving Post\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/siliconvalleymovingpost.com\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/siliconvalleymovingpost.com\\\/?p=12554#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/siliconvalleymovingpost.com\\\/?p=12554#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/siliconvalleymovingpost.com\\\/wp-content\\\/uploads\\\/2026\\\/06\\\/02fc9b0f2ae5482c94e624742994bd94.webp\",\"datePublished\":\"2026-06-05T17:31:47+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/siliconvalleymovingpost.com\\\/#\\\/schema\\\/person\\\/636e2e5a10a21cf87fe6eb5951e8a6b7\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/siliconvalleymovingpost.com\\\/?p=12554#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/siliconvalleymovingpost.com\\\/?p=12554\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/siliconvalleymovingpost.com\\\/?p=12554#primaryimage\",\"url\":\"https:\\\/\\\/siliconvalleymovingpost.com\\\/wp-content\\\/uploads\\\/2026\\\/06\\\/02fc9b0f2ae5482c94e624742994bd94.webp\",\"contentUrl\":\"https:\\\/\\\/siliconvalleymovingpost.com\\\/wp-content\\\/uploads\\\/2026\\\/06\\\/02fc9b0f2ae5482c94e624742994bd94.webp\",\"width\":1024,\"height\":682},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/siliconvalleymovingpost.com\\\/?p=12554#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/siliconvalleymovingpost.com\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Anthropic urges a way to pause AI development as risks grow with the tech advances\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/siliconvalleymovingpost.com\\\/#website\",\"url\":\"https:\\\/\\\/siliconvalleymovingpost.com\\\/\",\"name\":\"Silicon Valley Moving Post\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/siliconvalleymovingpost.com\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/siliconvalleymovingpost.com\\\/#\\\/schema\\\/person\\\/636e2e5a10a21cf87fe6eb5951e8a6b7\",\"name\":\"admin\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/50b1ad2e498f523425ee0a8cc5180a210646db1622662a3d56cc405d3e0c346a?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/50b1ad2e498f523425ee0a8cc5180a210646db1622662a3d56cc405d3e0c346a?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/50b1ad2e498f523425ee0a8cc5180a210646db1622662a3d56cc405d3e0c346a?s=96&d=mm&r=g\",\"caption\":\"admin\"},\"sameAs\":[\"http:\\\/\\\/siliconvalleymovingpost.com\"],\"url\":\"https:\\\/\\\/siliconvalleymovingpost.com\\\/?author=1\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Anthropic urges a way to pause AI development as risks grow with the tech advances - Silicon Valley Moving Post","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/siliconvalleymovingpost.com\/?p=12554","og_locale":"en_US","og_type":"article","og_title":"Anthropic urges a way to pause AI development as risks grow with the tech advances - Silicon Valley Moving Post","og_description":"Anthropic is proposing that top AI companies coordinate a way to pause the development of advanced AI systems. The company behind the Claude chatbot says the technology is improving so quickly that there's a risk humans could lose control.","og_url":"https:\/\/siliconvalleymovingpost.com\/?p=12554","og_site_name":"Silicon Valley Moving Post","article_published_time":"2026-06-05T17:31:47+00:00","author":"admin","twitter_card":"summary_large_image","twitter_misc":{"Written by":"admin","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/siliconvalleymovingpost.com\/?p=12554#article","isPartOf":{"@id":"https:\/\/siliconvalleymovingpost.com\/?p=12554"},"author":{"name":"admin","@id":"https:\/\/siliconvalleymovingpost.com\/#\/schema\/person\/636e2e5a10a21cf87fe6eb5951e8a6b7"},"headline":"Anthropic urges a way to pause AI development as risks grow with the tech advances","datePublished":"2026-06-05T17:31:47+00:00","mainEntityOfPage":{"@id":"https:\/\/siliconvalleymovingpost.com\/?p=12554"},"wordCount":735,"commentCount":0,"image":{"@id":"https:\/\/siliconvalleymovingpost.com\/?p=12554#primaryimage"},"thumbnailUrl":"https:\/\/siliconvalleymovingpost.com\/wp-content\/uploads\/2026\/06\/02fc9b0f2ae5482c94e624742994bd94.webp","articleSection":["Technology"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/siliconvalleymovingpost.com\/?p=12554#respond"]}]},{"@type":"WebPage","@id":"https:\/\/siliconvalleymovingpost.com\/?p=12554","url":"https:\/\/siliconvalleymovingpost.com\/?p=12554","name":"Anthropic urges a way to pause AI development as risks grow with the tech advances - Silicon Valley Moving Post","isPartOf":{"@id":"https:\/\/siliconvalleymovingpost.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/siliconvalleymovingpost.com\/?p=12554#primaryimage"},"image":{"@id":"https:\/\/siliconvalleymovingpost.com\/?p=12554#primaryimage"},"thumbnailUrl":"https:\/\/siliconvalleymovingpost.com\/wp-content\/uploads\/2026\/06\/02fc9b0f2ae5482c94e624742994bd94.webp","datePublished":"2026-06-05T17:31:47+00:00","author":{"@id":"https:\/\/siliconvalleymovingpost.com\/#\/schema\/person\/636e2e5a10a21cf87fe6eb5951e8a6b7"},"breadcrumb":{"@id":"https:\/\/siliconvalleymovingpost.com\/?p=12554#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/siliconvalleymovingpost.com\/?p=12554"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/siliconvalleymovingpost.com\/?p=12554#primaryimage","url":"https:\/\/siliconvalleymovingpost.com\/wp-content\/uploads\/2026\/06\/02fc9b0f2ae5482c94e624742994bd94.webp","contentUrl":"https:\/\/siliconvalleymovingpost.com\/wp-content\/uploads\/2026\/06\/02fc9b0f2ae5482c94e624742994bd94.webp","width":1024,"height":682},{"@type":"BreadcrumbList","@id":"https:\/\/siliconvalleymovingpost.com\/?p=12554#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/siliconvalleymovingpost.com\/"},{"@type":"ListItem","position":2,"name":"Anthropic urges a way to pause AI development as risks grow with the tech advances"}]},{"@type":"WebSite","@id":"https:\/\/siliconvalleymovingpost.com\/#website","url":"https:\/\/siliconvalleymovingpost.com\/","name":"Silicon Valley Moving Post","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/siliconvalleymovingpost.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/siliconvalleymovingpost.com\/#\/schema\/person\/636e2e5a10a21cf87fe6eb5951e8a6b7","name":"admin","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/50b1ad2e498f523425ee0a8cc5180a210646db1622662a3d56cc405d3e0c346a?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/50b1ad2e498f523425ee0a8cc5180a210646db1622662a3d56cc405d3e0c346a?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/50b1ad2e498f523425ee0a8cc5180a210646db1622662a3d56cc405d3e0c346a?s=96&d=mm&r=g","caption":"admin"},"sameAs":["http:\/\/siliconvalleymovingpost.com"],"url":"https:\/\/siliconvalleymovingpost.com\/?author=1"}]}},"_links":{"self":[{"href":"https:\/\/siliconvalleymovingpost.com\/index.php?rest_route=\/wp\/v2\/posts\/12554","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/siliconvalleymovingpost.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/siliconvalleymovingpost.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/siliconvalleymovingpost.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/siliconvalleymovingpost.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=12554"}],"version-history":[{"count":0,"href":"https:\/\/siliconvalleymovingpost.com\/index.php?rest_route=\/wp\/v2\/posts\/12554\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/siliconvalleymovingpost.com\/index.php?rest_route=\/wp\/v2\/media\/12553"}],"wp:attachment":[{"href":"https:\/\/siliconvalleymovingpost.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=12554"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/siliconvalleymovingpost.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=12554"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/siliconvalleymovingpost.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=12554"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}