AI Eye: Is AI a nuke-level threat? Why AI fields all advance at once, dumb pic puns

12 June 2023

Cointelegraph By Andrew Fenton

Just as we don’t allow just anyone to build a plane and fly passengers around, or design and release medicines, why should we allow AI models to be released into the wild without proper testing and licensing? 

That’s been the argument from an increasing number of experts and politicians in recent weeks. 

With the United Kingdom holding a global summit on AI safety in autumn, and surveys suggesting around 60% of the public is in favor of regulations, it seems new guardrails are becoming more likely than not. 

One particular meme taking hold is the comparison of AI tech to an existential threat like nuclear weaponry, as in a recent 23-word warning sent by the Center of AI Safety, which was signed by hundreds of scientists:

“Mitigating the risk of extinction from AI should be a global priority alongside other societal-scale risks such as pandemics and nuclear war.”

Extending the metaphor, OpenAI CEO Sam Altman is pushing for the creation of a global body like the International Atomic Energy Agency to oversee the tech.

“We talk about the IAEA as a model where the world has said, ‘OK, very dangerous technology, let’s all put (in) some guard rails,’” he said in India this week. 

Libertarians argue that overstating the threat and calling for regulations is just a ploy by the leading AI companies to a) impose authoritarian control and b) strangle competition via regulation. 

Princeton computer science professor Arvind Narayanan warned, “We should be wary of Prometheans who want to both profit from bringing the people fire and be trusted as the firefighters.”

Netscape and a16z co-founder Marc Andreessen released a series of essays this week on his technological utopian vision for AI. He likened AI doomers to “an apocalyptic cult” and claimed AI is no more likely to wipe out humanity than a toaster because: “AI doesn’t want, it doesn’t have goals — it doesn’t want to kill you because it’s not alive.”

This may or may not be true — but then again, we only have a vague understanding of what goes on inside the black box of the AI’s “thought processes.” But as Andreessen himself admits, the planet is full of unhinged humans who can now ask an AI to engineer a bioweapon, launch a cyberattack or manipulate an election. So, it can be dangerous in the wrong hands even if we avoid the Skynet/Terminator scenario. 

The nuclear comparison is probably quite instructive in that people did get very carried away in the 1940s about the very real world-ending possibilities of nuclear technology. Some Manhattan Project team members were so worried the bomb might set off a chain reaction, ignite the atmosphere and incinerate all life on Earth that they pushed for the project to be abandoned. 

After the bomb was dropped, Albert Einstein became so convinced of the scale of the threat that he pushed for the immediate formation of a world government with sole control of the arsenal.

Read also


Features

North Korean crypto hacking: Separating fact from fiction


Features

Game theory meets DeFi: Bouncing ideas around tokenomic design

The world government didn’t happen but the international community took the threat seriously enough that humans have managed not to blow themselves up in the 80-odd years since. Countries signed agreements to only test nukes underground to limit radioactive fallout and set up inspection regimes, and now only nine countries have nuclear weapons. 

In their podcast about the ramifications of AI on society, The AI Dilemma, Tristan Harris and Aza Raskin argue for the safe deployment of thoroughly tested AI models.

“I think of this public deployment of AI as above-ground testing of AI. We don’t need to do that,” argued Harris.

“We can presume that systems that have capacities that the engineers don’t even know what those capacities will be, that they’re not necessarily safe until proven otherwise. We don’t just shove them into products like Snapchat, and we can put the onus on the makers of AI, rather than on the citizens, to prove why they think that it’s (not) dangerous.”

Also read: All rise for the robot judge — AI and blockchain could transform the courtroom

The genie is out of the bottle

Of course, regulating AI might be like banning Bitcoin: nice in theory, impossible in practice. Nuclear weapons are highly specialized technology understood by just a handful of scientists worldwide and require enriched uranium, which is incredibly difficult to acquire. Meanwhile, open-source AI is freely available, and you can even download a personal AI model and run it on your laptop.

AI expert Brian Roemmele says that he’s aware of 450 public open-source AI models and “more are made almost hourly. Private models are in the 100s of 1000s.”

Roemmele is even building a system to enable any old computer with a dial-up modem to be able to connect to a locally hosted AI.

The United Arab Emirates also just released its open-source large language model AI called Falcon 40B model free of royalties for commercial and research. It claims it “outperforms competitors like Meta’s LLaMA and Stability AI’s StableLM.”

There’s even a just-released open-source text-to-video AI video generator called Potat 1, based on research from Runway. 

The reason all AI fields advanced at once

We’ve seen an incredible explosion in AI capability across the board in the past year or so, from AI text to video and song generation to magical seeming photo editing, voice cloning and one-click deep fakes. But why did all these advances occur in so many different areas at once?

Mathematician and Earth Species Project co-founder Aza Raskin gave a fascinating plain English explanation for this in The AI Dilemma, highlighting the breakthrough that emerged with the Transformer machine learning model.

Read also


Features

Crypto is changing how humanitarian agencies deliver aid and services


Features

The best (and worst) stories from 3 years of Cointelegraph Magazine

“The sort of insight was that you can start to treat absolutely everything as language,” he explained. “So, you can take, for instance, images. You can just treat it as a kind of language, it’s just a set of image patches that you can arrange in a linear fashion, and then you just predict what comes next.”

ChatGPT is often likened to a machine that just predicts the most likely next word, so you can see the possibilities of being able to generate the next “word” if everything digital can be transformed into a language. 

“So, images can be treated as language, sound you break it up into little microphone names, predict which one of those comes next, that becomes a language. fMRI data becomes a kind of language, DNA is just another kind of language. And so suddenly, any advance in any one part of the AI world became an advance in every part of the AI world. You could just copy-paste, and you can see how advances now are immediately multiplicative across the entire set of fields.”

It is and isn’t like Black Mirror

A lot of people have observed that recent advances in artificial intelligence seem like something out of Black Mirror. But creator Charlie Brooker seems to think his imagination is considerably more impressive than the reality, telling Empire Magazine he’d asked ChatGPT to write an episode of Black Mirror and the result was “shit.”

“I’ve toyed around with ChatGPT a bit,” Brooker said. “The first thing I did was type ‘generate Black Mirror episode’ and it comes up with something that, at first glance, reads plausibly, but on second glance, is shit.” According to Brooker, the AI just regurgitated and mashed up different episode plots into a total mess.

“If you dig a bit more deeply, you go, ‘Oh, there’s not actually any real original thought here,’” he said.

“Black Mirror” was better at predicting AI advances than AI was at writing “Black Mirror” scripts (Netflix)

AI pictures of the week

One of the nice things about AI text-to-speech image generation programs is they can turn throwaway puns into expensive-looking images that no graphic designer could be bothered to make. Here then, are the wonders of the world, misspelled by AI (courtesy of redditor mossymayn).

Machu Pikachu (RedditThe Grand Crayon (Reddit)The Great Ball of China (Reddit)The Hooter Dam (Reddit)The Sydney Oprah House (Reddit)China’s Panacotta Army (Reddit)

Video of the week

Researchers from the University of Cambridge demonstrated eight simple salad recipes to an AI robot chef that was then able to make the salads itself and come up with a ninth salad recipe on its own.

  

You might also like

Bitcoin ETFs log $912M inflows in ‘dramatic’ investor sentiment boost  
Bitcoin ETFs log $912M inflows in ‘dramatic’ investor sentiment boost  

Investments in Bitcoin exchange-traded funds (ETFs) have rebounded to levels last seen in January, signaling a recovery in investor sentiment from concerns about global trade tariff escalations.US spot Bitcoin (BTC) ETFs had over $912 million worth of cumulative net inflows on April 22, marking their highest daily investment in more than three months since Jan. 21, Farside Investors data shows.Bitcoin ETF Flow, millions. Source: Farside Investors“Bitcoin ETPs just saw the largest daily inflows since 21st January in a dramatic improvement in sentiment,” according to James Butterfill, head of research at CoinShares.Related: Bitcoin still on track for $1.8M in 2035, says analystInvestor sentiment appeared to improve after US President Donald Trump said that import tariffs on Chinese goods will “come down substantially,” adopting a softer tone in negotiations.The de-escalation and growing ETF inflows pushed Bitcoin price above $93,000 for the first time in seven weeks, Cointelegraph reported on April 23.The growing institutional investment and presence of ETFs may also accelerate the historic four-year cycle and bolster BTC to new highs before the end of 2025, analysts told Cointelegraph.US dollar weakness may reinforce Bitcoin’s safe-haven appealThe US dollar’s weakness may contribute to the growing investor demand for Bitcoin. DXY, year-to-date chart. Source: Cointelegraph/TradingView The US Dollar Index (DXY), which measures the strength of the greenback against a basket of leading fiat currencies, fell nearly 9% since the beginning of 2025, to an over three-year low of 98.8 last seen in April 2022, TradingView data shows.“Macro factors like a weakening dollar and rising gold correlation,” may reinforce Bitcoin’s appeal as a hedge against economic volatility, Ryan Lee, chief analyst at Bitget Research, told Cointelegraph.Related: Crypto, stocks enter ‘new phase of trade war’ as US-China tensions riseBitcoin no longer trading in the “shadow of tech”Crypto and traditional stock markets are “walking a tightrope between political drama and economic reality,” with Bitcoin staging a significant rebound thanks to “strong ETF inflows, institutional acquisitions, and a weakening US dollar,” according to Nexo dispatch analyst Iliya Kalchev:“Bitcoin’s strength amid dollar weakness, record gold prices, and renewed institutional buying reflects a market recalibrating what safety looks like.”“The conversation has clearly shifted. Bitcoin is no longer trading in the shadows of tech — it’s becoming a lens through which macro uncertainty is priced,” he added.Nansen CEO Alex Svanevik also praised Bitcoin’s resilience, noting that the maturing asset is becoming “less Nasdaq — more gold” over the past two weeks, increasingly acting as a safe haven asset against economic turmoil, though concerns over economic recession may limit its price trajectory.On April 21, BitMEX co-founder Arthur Hayes predicted that this might be the “last chance” to buy Bitcoin below $100,000, as the incoming US Treasury buybacks may signal the next significant catalyst for Bitcoin price.Magazine: Bitcoin’s odds of June highs, SOL’s $485M outflows, and more: Hodler’s Digest, March 2 – 8

Binance tightens South African compliance rules for crypto transfers  
Binance tightens South African compliance rules for crypto transfers  

Binance is set to implement new compliance measures for South African users, requiring sender and receiver information for all crypto deposits and withdrawals.In an announcement on April 23, the largest exchange in terms of daily trading volume of cryptocurrencies said the move comes in response to local regulatory demands.Starting April 30, Binance users in South Africa will be prompted to provide additional information when transferring crypto.For deposits, users must disclose the sender’s full name, country of residence, and, if applicable, the name of the originating crypto exchange. Similarly, withdrawals will require beneficiary details before processing.Binance to require information for all crypto transfers in South Africa. Source: BinanceThe update will only impact crypto deposits and withdrawals, leaving trading and other platform features unaffected.Related: US judge transfers Binance lawsuit to Florida, citing first-to-file ruleMissing transfer details may reverse transactionsBinance warned that failure to provide the required information may result in delayed transactions or, in some cases, a return of funds to the sender.In preparation for the rollout, users will need to re-login to their accounts starting April 24.The change comes as South Africa moves to boost oversight of the rapidly moving crypto sector.On April 2, Bloomberg reported that South Africa’s Revenue Service (SARS) is urging individuals, crypto exchanges and intermediaries involved in crypto transactions to register with the authority, warning that failure to do so is now illegal.In March, the Financial Sector Conduct Authority (FSCA) of South Africa issued a public warning against two unlicensed crypto firms, Afriinvest and Mutualwealth, accusing them of soliciting investments while promising unrealistic returns of up to 10,000 rand ($542) per day.Related: Binance, KuCoin, MEXC report service issues due to AWS network interruptionSouth Africa pushes to become key crypto hubEmerging economies across Africa, particularly South Africa, are positioning themselves as potential digital asset hubs amid growing regulatory clarity, Ben Caselin, chief marketing officer (CMO) of Johannesburg-based crypto exchange VALR, told Cointelegraph in September 2024.Caselin said that South Africa’s strong legal framework and ease of business make it a key entry point for crypto expansion across the continent.The South African crypto market is projected to generate $278 million in revenue in 2025, with expectations to grow at a compound annual growth rate (CAGR) of 7.86% and reach $332.9 million by 2028, according to Statista.Revenue in South Africa’s crypto market is expected to grow by 7.86% by 2028. Source: StatistaRegulatory momentum is increasing, with the FSCA approving 59 crypto platform licenses in March 2024, while over 260 applications remain under review.Cointelegraph contacted Binance for comments but did not receive a response by publication.Magazine: Former Love Island star’s tips on how to go viral in crypto: Van00sa, X Hall of Flame

SEC says it won’t re-file fraud case against Hex’s Richard Heart  
SEC says it won’t re-file fraud case against Hex’s Richard Heart  

The US Securities and Exchange Commission has said it doesn’t intend to refile its securities fraud complaint against Hex founder Richard Schueler, who goes by Richard Heart.“Plaintiff Securities and Exchange Commission provides this notice that it does not intend to file an amended complaint in this matter,” the regulator’s lawyer, Matthew Gulde, stated in an April 21 letter to New York District Court Judge Carol Bagley Amon. The court had previously dismissed the SEC’s original complaint on Feb. 28 as Judge Amon said the regulator failed to establish that it had jurisdiction over Heart’s activities, which she said were not specifically targeted at US investors.She granted leave for the SEC to file an amended complaint by March 20, later extending the deadline to April 21.Heart posted to X on April 22 that “Richard Heart, PulseChain, PulseX, and HEX have defeated the SEC completely and have achieved regulatory clarity that nearly no other coins have.”Letter from the SEC to Judge Amon. Source: PACERHeart added that the SEC walked away from some of its other cryptocurrency cases voluntarily, but claimed his was the only case where “the SEC lost and crypto won across the board, with a dismissal in court of every single claim the SEC brought.”Heart said it was a victory for open-source software, cryptocurrency and free speech because the SEC “actually sued software code itself in this case.” SEC hunted Heart in FinlandThe SEC sued Heart in July 2023 for alleged unregistered securities offerings of three tokens, HEX, PulseChain (PLS), and PulseX (PSLX), claiming he made more than $1 billion by touting the tokens as a “pathway to grandiose wealth for investors.”In April 2024, Heart tried to have the suit tossed, claiming the regulator “has no sway over him,” because he didn’t reside in the United States. Related: Finnish police seize watches worth $2.6M from Hex founder Richard Heart: ReportThe SEC opposed this in August, claiming he touted the tokens at a Las Vegas event. In December 2024, Interpol issued a Red Notice for Heart, seeking his arrest in Finland, where he was also suspected of tax evasion. The PulseChain native token (HEX) hit an all-time high of $0.031 in December 2024 but has since tanked 76% as most altcoins have failed to follow Bitcoin’s momentum this year. The SEC has dropped or suspended several cases against crypto firms so far this year under the Trump administration.Magazine: Altcoin season to hit in Q2? Mantra’s plan to win trust: Hodler’s Digest

Open chat
1
BlockFo Chat
Hello 👋, How can we help you?
📱 When you've pressed the BlockFo button, we automatically transfer to WhatsApp 🔝🔐
🖥️ Or, if you use a PC or Mac, then we'll open a new window to load your desktop app.