AI Eye: Is AI a nuke-level threat? Why AI fields all advance at once, dumb pic puns

12 June 2023

Cointelegraph By Andrew Fenton

Just as we don’t allow just anyone to build a plane and fly passengers around, or design and release medicines, why should we allow AI models to be released into the wild without proper testing and licensing? 

That’s been the argument from an increasing number of experts and politicians in recent weeks. 

With the United Kingdom holding a global summit on AI safety in autumn, and surveys suggesting around 60% of the public is in favor of regulations, it seems new guardrails are becoming more likely than not. 

One particular meme taking hold is the comparison of AI tech to an existential threat like nuclear weaponry, as in a recent 23-word warning sent by the Center of AI Safety, which was signed by hundreds of scientists:

“Mitigating the risk of extinction from AI should be a global priority alongside other societal-scale risks such as pandemics and nuclear war.”

Extending the metaphor, OpenAI CEO Sam Altman is pushing for the creation of a global body like the International Atomic Energy Agency to oversee the tech.

“We talk about the IAEA as a model where the world has said, ‘OK, very dangerous technology, let’s all put (in) some guard rails,’” he said in India this week. 

Libertarians argue that overstating the threat and calling for regulations is just a ploy by the leading AI companies to a) impose authoritarian control and b) strangle competition via regulation. 

Princeton computer science professor Arvind Narayanan warned, “We should be wary of Prometheans who want to both profit from bringing the people fire and be trusted as the firefighters.”

Netscape and a16z co-founder Marc Andreessen released a series of essays this week on his technological utopian vision for AI. He likened AI doomers to “an apocalyptic cult” and claimed AI is no more likely to wipe out humanity than a toaster because: “AI doesn’t want, it doesn’t have goals — it doesn’t want to kill you because it’s not alive.”

This may or may not be true — but then again, we only have a vague understanding of what goes on inside the black box of the AI’s “thought processes.” But as Andreessen himself admits, the planet is full of unhinged humans who can now ask an AI to engineer a bioweapon, launch a cyberattack or manipulate an election. So, it can be dangerous in the wrong hands even if we avoid the Skynet/Terminator scenario. 

The nuclear comparison is probably quite instructive in that people did get very carried away in the 1940s about the very real world-ending possibilities of nuclear technology. Some Manhattan Project team members were so worried the bomb might set off a chain reaction, ignite the atmosphere and incinerate all life on Earth that they pushed for the project to be abandoned. 

After the bomb was dropped, Albert Einstein became so convinced of the scale of the threat that he pushed for the immediate formation of a world government with sole control of the arsenal.

Read also


Features

North Korean crypto hacking: Separating fact from fiction


Features

Game theory meets DeFi: Bouncing ideas around tokenomic design

The world government didn’t happen but the international community took the threat seriously enough that humans have managed not to blow themselves up in the 80-odd years since. Countries signed agreements to only test nukes underground to limit radioactive fallout and set up inspection regimes, and now only nine countries have nuclear weapons. 

In their podcast about the ramifications of AI on society, The AI Dilemma, Tristan Harris and Aza Raskin argue for the safe deployment of thoroughly tested AI models.

“I think of this public deployment of AI as above-ground testing of AI. We don’t need to do that,” argued Harris.

“We can presume that systems that have capacities that the engineers don’t even know what those capacities will be, that they’re not necessarily safe until proven otherwise. We don’t just shove them into products like Snapchat, and we can put the onus on the makers of AI, rather than on the citizens, to prove why they think that it’s (not) dangerous.”

Also read: All rise for the robot judge — AI and blockchain could transform the courtroom

The genie is out of the bottle

Of course, regulating AI might be like banning Bitcoin: nice in theory, impossible in practice. Nuclear weapons are highly specialized technology understood by just a handful of scientists worldwide and require enriched uranium, which is incredibly difficult to acquire. Meanwhile, open-source AI is freely available, and you can even download a personal AI model and run it on your laptop.

AI expert Brian Roemmele says that he’s aware of 450 public open-source AI models and “more are made almost hourly. Private models are in the 100s of 1000s.”

Roemmele is even building a system to enable any old computer with a dial-up modem to be able to connect to a locally hosted AI.

The United Arab Emirates also just released its open-source large language model AI called Falcon 40B model free of royalties for commercial and research. It claims it “outperforms competitors like Meta’s LLaMA and Stability AI’s StableLM.”

There’s even a just-released open-source text-to-video AI video generator called Potat 1, based on research from Runway. 

The reason all AI fields advanced at once

We’ve seen an incredible explosion in AI capability across the board in the past year or so, from AI text to video and song generation to magical seeming photo editing, voice cloning and one-click deep fakes. But why did all these advances occur in so many different areas at once?

Mathematician and Earth Species Project co-founder Aza Raskin gave a fascinating plain English explanation for this in The AI Dilemma, highlighting the breakthrough that emerged with the Transformer machine learning model.

Read also


Features

Crypto is changing how humanitarian agencies deliver aid and services


Features

The best (and worst) stories from 3 years of Cointelegraph Magazine

“The sort of insight was that you can start to treat absolutely everything as language,” he explained. “So, you can take, for instance, images. You can just treat it as a kind of language, it’s just a set of image patches that you can arrange in a linear fashion, and then you just predict what comes next.”

ChatGPT is often likened to a machine that just predicts the most likely next word, so you can see the possibilities of being able to generate the next “word” if everything digital can be transformed into a language. 

“So, images can be treated as language, sound you break it up into little microphone names, predict which one of those comes next, that becomes a language. fMRI data becomes a kind of language, DNA is just another kind of language. And so suddenly, any advance in any one part of the AI world became an advance in every part of the AI world. You could just copy-paste, and you can see how advances now are immediately multiplicative across the entire set of fields.”

It is and isn’t like Black Mirror

A lot of people have observed that recent advances in artificial intelligence seem like something out of Black Mirror. But creator Charlie Brooker seems to think his imagination is considerably more impressive than the reality, telling Empire Magazine he’d asked ChatGPT to write an episode of Black Mirror and the result was “shit.”

“I’ve toyed around with ChatGPT a bit,” Brooker said. “The first thing I did was type ‘generate Black Mirror episode’ and it comes up with something that, at first glance, reads plausibly, but on second glance, is shit.” According to Brooker, the AI just regurgitated and mashed up different episode plots into a total mess.

“If you dig a bit more deeply, you go, ‘Oh, there’s not actually any real original thought here,’” he said.

“Black Mirror” was better at predicting AI advances than AI was at writing “Black Mirror” scripts (Netflix)

AI pictures of the week

One of the nice things about AI text-to-speech image generation programs is they can turn throwaway puns into expensive-looking images that no graphic designer could be bothered to make. Here then, are the wonders of the world, misspelled by AI (courtesy of redditor mossymayn).

Machu Pikachu (RedditThe Grand Crayon (Reddit)The Great Ball of China (Reddit)The Hooter Dam (Reddit)The Sydney Oprah House (Reddit)China’s Panacotta Army (Reddit)

Video of the week

Researchers from the University of Cambridge demonstrated eight simple salad recipes to an AI robot chef that was then able to make the salads itself and come up with a ninth salad recipe on its own.

  

You might also like

Trump supports bill to buy 1 million BTC — Senator Lummis  
Trump supports bill to buy 1 million BTC — Senator Lummis  

US President Donald Trump supports the BITCOIN Act and has a team of experts in the White House working to roll out landmark digital asset legislation in the coming weeks, according to Wyoming Senator Cynthia Lummis. Speaking at the Bitcoin 2025 conference in Las Vegas, Nevada, Lummis said she is bringing the BITCOIN ACT to the “attention of the American people and the world,” adding that, “President Trump supports the bill.”In March, Lummis reintroduced the BITCOIN Act — landmark legislation that directs the US government to acquire 1 million Bitcoin (BTC) over five years. The acquisitions would be financed using existing funds within the Federal Reserve System and the Treasury Department. As Cointelegraph reported, the Trump administration has reiterated the need to use “budget-neutral ways” to acquire Bitcoin without burdening taxpayers.Source: CryptoGoosAt the Bitcoin Conference, Lummis said the Trump administration has a team working on “digital asset issues,” including legislation on stablecoins, market structure and the Bitcoin Strategic Reserve.“They will probably roll out in that order,” she said.“The Senate Banking Committee has passed the stablecoin bill out of committee,” said Lummis, adding: “We’re getting close to being ready to have it on the floor. We’ve worked for untold hours with the minority party to satisfy them, and we should be voting on it the week before we get back from this break.”Related: Senator Lummis’ new BITCOIN Act allows US reserve to exceed 1M BitcoinGENIUS Act on stablecoins is “going to pass,” says White House crypto czarThe White House seems to be in alignment with Senator Lummis. Last week, Trump’s top crypto adviser, David Sacks, said the GENIUS stablecoin bill is “going to pass” the Senate with bipartisan support after clearing a key procedural vote on May 19.On May 19, the Senate voted 66 to 32 to advance debate on the GENIUS Bill. Source: US SenateGENIUS refers to the Guiding and Establishing National Innovation for US Stablecoins Act, possibly the most comprehensive federal push to establish a legal framework for dollar-pegged stablecoins.Stablecoins have become one of the most prominent use cases for blockchain technology, with some industry advocates arguing that they could help extend the US dollar’s dominance as the global reserve currency.Collateralized, dollar-backed stablecoins like Tether’s USDt (USDT) and Circle’s USDC (USDC) account for more than 85% of the $250 billion market, according to CoinMarketCap.Related: Former CFTC chair criticizes STABLE Act amid calls for urgent regulatory clarity

Growing BTC reserve requires Congressional legislation — VanEck exec  
Growing BTC reserve requires Congressional legislation — VanEck exec  

Building a permanent US strategic Bitcoin reserve would likely require targeted legislation rather than executive action, according to VanEck’s head of digital assets, Matthew Sigel. Speaking at Bitcoin 2025 in Las Vegas, Sigel said the most viable path forward may involve inserting Bitcoin mining incentives into the congressional budget reconciliation process.According to Sigel, the most effective path to growing a US strategic Bitcoin reserve would be through targeted amendments to congressional budget legislation. These could include tax credits for mining companies that use methane gas and other incentives aimed at encouraging miners to share a portion of their mined BTC with the federal government. He argued that such an approach would allow the reserve to grow organically over time. Sigel also highlighted the limitations of executive actions in achieving this goal:”The problem with executive action is that it’s going to prompt lawsuits. And anything over $100 million is going to get sued by the Elizabeth Warrens of the world. So, I would say start with something maybe in the Exchange Stabilization Fund for $100 million.”US President Donald Trump established the US Bitcoin Strategic Reserve through a March 7 executive order. According to the order, the US government can only acquire Bitcoin through budget-neutral strategies or asset forfeiture, prompting a range of different ideas on how to add to the government’s stockpile of nearly 200,000 BTC.From left to right, Alex Thorn, Matthew Sigel, Matthew Pines and Fred Thiel. Source: Turner Wright/CointelegraphRelated: Bitcoin’s new highs may have been driven by Japan bond market crisisLawmakers, officials pitch different ideas to grow strategic Bitcoin reserveWyoming Senator Cynthia Lummis, the US lawmaker who introduced legislation for a Bitcoin strategic reserve in July 2024, proposed converting a portion of the gold certificates held by the US Treasury to Bitcoin.Converting gold to Bitcoin would allow the US government to purchase more Bitcoin without incurring a cost to the taxpayer, Lummis said.Bo Hines, the executive director of the President’s Council of Advisers on Digital Assets, echoed the idea in March 2025.Hines called on the US Treasury to revalue its gold holdings, which are currently priced at just $42.22 per troy ounce, and convert a portion of those gains to Bitcoin. This strategy would also be budget-neutral, Hines said.The price of gold reached an all-time high of $3,500 per ounce in April but experienced a minor pullback to around $3,300 on May 27.Magazine: TradFi fans ignored Lyn Alden’s BTC tip — Now she says it’ll hit 7 figures: X Hall of Flame

ZKPs can prove I'm old enough without telling you my age  
ZKPs can prove I'm old enough without telling you my age  

Opinion by: Andre Omietanski, General Counsel, and Amal Ibraymi, Legal Counsel at Aztec LabsWhat if you could prove you’re over 18, without revealing your birthday, name, or anything else at all? Zero-knowledge proofs (ZKPs) make this hypothetical a reality and solve one of the key challenges online: verifying age without sacrificing privacy. The need for better age verification todayWe’re witnessing an uptick in laws being proposed restricting minors’ access to social media and the internet, including in Australia, Florida, and China. To protect minors from inappropriate adult content, platform owners and governments often walk a tightrope between inaction and overreach. For example, the state of Louisiana in the US recently enacted a law meant to block minors from viewing porn. Sites required users to upload an ID before viewing content. The Free Speech Coalition challenged the law as unconstitutional, making the case that it infringed on First Amendment rights. The lawsuit was eventually dismissed on procedural grounds. The reaction, however, highlights the dilemma facing policymakers and platforms: how to block minors without violating adults’ rights or creating new privacy risks.Traditional age verification failsCurrent age verification tools are either ineffective or invasive. Self-declaration is meaningless, since users can simply lie about their age. ID-based verification is overly invasive. No one should be required to upload their most sensitive documents, putting themselves at risk of data breaches and identity theft. Biometric solutions like fingerprints and face scans are convenient for users but raise important ethical, privacy, and security concerns. Biometric systems are not always accurate and may generate false positives and negatives. The irreversible nature of the data, which can’t be changed like a regular password can, is also less than ideal. Other methods, like behavioral tracking and AI-driven verification of browser patterns, are also problematic, using machine learning to analyze user interactions and identify patterns and anomalies, raising concerns of a surveillance culture.ZKPs as the privacy-preserving solutionZero-knowledge proofs present a compelling solution. Like a government ID provider, a trusted entity verifies the user’s age and generates a cryptographic proof confirming they are over the required age. Websites only need to check the proof, not the excess personal data, ensuring privacy while keeping minors at the gates. No centralized data storage is required, alleviating the burden on platforms such as Google, Meta, and WhatsApp and eliminating the risk of data breaches. Recent: How zero-knowledge proofs can make AI fairerAdopting and enforcing ZKPs at scaleZKPs aren’t a silver bullet. They can be complex to implement. The notion of “don’t trust, verify,” proven by indisputable mathematics, may cause some regulatory skepticism. Policymakers may hesitate to trust cryptographic proofs over visible ID verification. There are occasions when companies may need to disclose personal information to authorities, such as during an investigation into financial crimes or government inquiries. This would challenge ZKPs, whose very intention is for platforms not to hold this data in the first place.ZKPs also struggle with scalability and performance, being somewhat computationally intensive and tricky to program. Efficient implementation techniques are being explored, and breakthroughs, such as the Noir programming language, are making ZKPs more accessible to developers, driving the adoption of secure, privacy-first solutions. A safer, smarter future for age verificationGoogle’s move to adopt ZKPs for age verification is a promising signal that mainstream platforms are beginning to embrace privacy-preserving technologies. But to fully realize the potential of ZKPs, we need more than isolated solutions locked into proprietary ecosystems. Crypto-native wallets can go further. Open-source and permissionless blockchain-based systems offer interoperability, composability, and programmable identity. With a single proof, users can access a range of services across the open web — no need to start from scratch every time, or trust a single provider (Google) with their credentials.ZKPs flip the script on online identity — proving what matters, without exposing anything else. They protect user privacy, help platforms stay compliant, and block minors from restricted content, all without creating new honeypots of sensitive data.Google’s adoption of ZKPs shows mainstream momentum is building. But to truly transform digital identity, we must embrace crypto-native, decentralized systems that give users control over what they share and who they are online.In an era defined by surveillance, ZKPs offer a better path forward — one that’s secure, private, and built for the future.Opinion by: Andre Omietanski, General Counsel, and Amal Ibraymi, Legal Counsel at Aztec Labs.This article is for general information purposes and is not intended to be and should not be taken as legal or investment advice. The views, thoughts, and opinions expressed here are the author’s alone and do not necessarily reflect or represent the views and opinions of Cointelegraph.