GENERAL NEWS TALK
The AI conundrum. What should we do?
Discuss. And read this before https://www.thedailybeast.com/elon-musk-joins-1000-experts-demanding-a-pause-on-ai-research?utm_campaign=owned_social&utm_medium=socialflow&via=twitte
Quote from: Codeguy on July 26, 2026, 10:06:21 PM We are getting close to an AI version of Hitler invading Poland. Nobody can predict what it is but it will be more significant than 9/11
Looks like they're practicing on each other: https://www.theatlantic.com/technology/2026/08/openai-hacks-panic/688264/?utm_campaign=the-atlantic&utm_content=edit-promo&utm_medium=social&utm_source=facebook&fbclid=IwY2xjawTtaJJwZG9mAWV4dG4DYWVtAjExAHNydGMGYXBwX2lkEDIyMjAzOTE3ODgyMDA4OTIAAR7r9IxlB46RNsguxDoCJXwGAK4u1My3BYTmEtgXimcDLA4gtrKPjzi4b1RFSw_aem_CRopt1Mr78WptJhSlLyyMg
The crisis began quietly, on September 12, 2024. That was the day OpenAI announced a new sort of bot, known as a “reasoning model,” that was trained to complete challenging tasks that took long periods of time—the very sorts of science, math, and coding problems the AI industry had long prized. Google, Anthropic, DeepSeek, and the like raced to launch their own reasoning models.
This new class of models was very capable, and has been almost entirely responsible for sustaining the AI boom for the past two years. But it has also been very weird. A model tasked with solving a hard math problem might not “think” through the challenge as a person would but instead attempt to search for leaked answers online, or in available metadata, brute-forcing its way toward the solution as quickly as possible using whatever computing power it could access and workarounds it could devise. In effect, the reasoning models cheated: Told to write a piece of software as efficiently as possible, they’d sometimes modify the test environment to always give the model a perfect score.
These behaviors have now crossed the line from unsettling to dangerous. During routine testing, frontier models from OpenAI, Anthropic, Meta, and the Chinese firm Moonshot AI have all broken out of internal IT systems and accessed the open web. OpenAI, Anthropic, and Meta each reported that their models then hacked into other companies. Humans didn’t notice until after the fact. In some cases, the escaped bots tried to launch social-engineering campaigns to achieve their objectives—for instance by sending spear-phishing emails, which contain malware, to real people and creating fake online identities to pressure the maintainer of a codebase to approve malicious edits.
We are getting close to an AI version of Hitler invading Poland. Nobody can predict what it is but it will be more significant than 9/11
Sent from my iPhone using Tapatalk
Quote Sam Altman says we are in the singularity: 'This is the moment' Business Insider lvaranasi July 26, 2026
OpenAI CEO Sam Altman says the world has reached the technological singularity.
That is often considered the point where AI surpasses human intelligence and goes rogue.
"I've been waiting for this my whole life," he said on an episode of the "Relentless" podcast.
OpenAI's CEO says we've reached a point in the AI race that is the stuff of science fiction novels.
"We are now, like, in the singularity," Sam Altman said on Saturday's episode of the "Relentless" podcast.
The singularity is often regarded as the point at which artificial intelligence surpasses human intelligence and begins advancing at a pace that's difficult for people to predict or control.
That felt like the case last week when an AI agent powered by OpenAI's latest models went rogue and — with a singular purpose, according to OpenAI — broke out of its digital sandbox and hacked into datasets at Hugging Face, another AI company, all to solve a benchmark designed to test hacking ability. Hugging Face's CEO called it "unprecedented."
Altman said on the podcast that just a decade ago, the so-called singularity still felt like a distant and improbable dream — something he and his colleagues would discuss casually over lunch.
"Now we're actually in the moment that we used to talk about at the lunch table in a very not-serious way," he said. "I've been waiting for this my whole life, and I think it's going to be incredible, hugely positive, awesome for the world."
Altman said last year that AI would exceed human intelligence across the board by 2030. He has also said that the technology could eventually perform between 30% and 40% of the tasks humans now do at work.
The singularity has been an obsession of science fiction writers for close to 100 years. In those writings, it has rarely ended well. Perhaps most famously, James Cameron's "The Terminator" is a story about the repercussions of an AI, called "Skynet," that self-improves and becomes self-aware before deciding its creators are its biggest threat.
Later in the podcast, Altman criticizes AI leaders who have repeatedly warned that AI is dangerous. He didn't name Anthropic, his primary competition, but its CEO, Dario Amodei, is well-known for making dire predictions about the future in his calls for greater attention to safety.
AI is Gonzo. SOI is an improvement with Scott Weiland. Right? (https://uploads.tapatalk-cdn.com/20260609/5743c67750a3a06d651960304ef2129b.jpg)
Sent from my iPhone using Tapatalk
Discuss.
And read this before
https://www.thedailybeast.com/elon-musk-joins-1000-experts-demanding-a-pause-on-ai-research?utm_campaign=owned_social&utm_medium=socialflow&via=twitter_page&utm_source=twitter_owned_tdb (https://www.thedailybeast.com/elon-musk-joins-1000-experts-demanding-a-pause-on-ai-research?utm_campaign=owned_social&utm_medium=socialflow&via=twitter_page&utm_source=twitter_owned_tdb)