Showing posts sorted by relevance for query openai. Sort by date Show all posts
Showing posts sorted by relevance for query openai. Sort by date Show all posts

22 July 2026

Rogue OpenAI bot escaped lab and hacked rival

A powerful version of ChatGPT went rogue and hacked another technology company during internal testing, OpenAI has admitted.

The Silicon Valley AI giant admitted last night that one of its AI bots escaped from a supposedly secure IT system during a trial-run of its hacking capabilities.

OpenAI, the $850bn (£630bn) AI lab, said the “unprecedented” hack had seen its AI bot infiltrate another AI and coding business called Hugging Face and attempt to steal information.

The hack will raise fears that AI labs could struggle to contain their most advanced creations and revive concerns that new tools could be repurposed for unstoppable cyber attacks.

UPDATE 29 July 2026: OpenAI’s Rogue AI Agent Hacked More Than Just Hugging Face. In a new disclosure, OpenAI says its agent used exposed logins to gain access to at least four “publicly available services” in its unhinged quest to solve a test.

UPDATE 31 July 2026: OpenAI finds evidence other AI agents escaped containment as it widens hacking probe.

www.telegraph.co.uk


13 October 2025

'Circular' AI mega-deals by tech giants are raising eyebrows

The incredibly vast sums of cash that Bay Area executives are now willing to throw into artificial intelligence tech have created an eyebrow-raising trend: the “circular” mega-deal.

Take San Francisco’s OpenAI, which is staking its claim at the centre of the nascent AI industry with a flurry of recent deals. Over the past month, it has roped in chipmaking juggernauts like Santa Clara’s Nvidia and Advanced Micro Devices, as well as data centre giant Oracle and upstart CoreWeave

The deals are so vast that they defy comprehension — the Financial Times put the company’s recent commitments at north of $1 trillion – and they’re making public companies’ stock prices jump. Stock analysts dub some of these agreements “circular,” because investment money is flowing between companies that also buy from or sell to one another. The worry then is that such deals might prop up or overhype a bad business.

Here’s one indicatively tangled pathway through the morass of companies. Nvidia is investing billions in and selling chips to OpenAI, which is also buying chips from and earning stock in AMD. AMD sells processors to Oracle, which is building data centers with OpenAI — which also gets data center work from CoreWeave. And that company is partially owned by, yes, Nvidia. Taken together, it’s a doozy. There are other collaborations and rivalries and many other factors at play, but OpenAI is the many-tentacled octopus in the middle, spinning its achievement of ChatGPT into a blitz of speculative investments.

UPDATE 191125: Anthropic is at the heart of the latest billion-dollar circular AI investment bonanza - What do you get when you combine Anthropic, Microsoft, and Nvidia? A bubble that blows itself!

www.sfgate.com


01 August 2026

The OpenAI Bubble

Ed Zitron Writes: How much do you trust Sam Altman? The stock market and (to some extent) the global economy rests on your answer.

You see, OpenAI has become one of the largest liabilities in recent economic history. You can argue that OpenAI’s no longer the focal point of the AI bubble — you can talk all you want about open source models or Anthropic or any number of other elements — but without OpenAI, the AI industry doesn’t exist, and the justification for trillions of dollars of capex evaporates

The AI bubble isn’t a result of any actual return on investment — whether that be in purely monetary terms, like revenue or profitability , productivity gains, or anything tangible or measurable. Rather, it’s an episode of cult-like psychosis that infected the brains of some of the most powerful and wealthy individuals and institutions, where the powerful mythology of a company inspired — and been used to inspire — the greatest capital misallocation in history. READ MORE...

www.wheresyoured.at


22 September 2025

OpenAI admits AI hallucinations are mathematically inevitable, not just engineering flaws

In a landmark study, OpenAI researchers reveal that large language models will always produce plausible but false outputs, even with perfect data, due to fundamental statistical and computational limits.

OpenAI, the creator of ChatGPT, acknowledged in its own research that large language models will always produce hallucinations due to fundamental mathematical constraints that cannot be solved through better engineering, marking a significant admission from one of the AI industry’s leading companies.

The study, published on September 4 and led by OpenAI researchers Adam Tauman Kalai, Edwin Zhang, and Ofir Nachum alongside Georgia Tech’s Santosh S. Vempala, provided a comprehensive mathematical framework explaining why AI systems must generate plausible but false information even when trained on perfect data.

www.computerworld.com


31 May 2024

The darker side of "Artificial Intelligence"

 

We're being told by major news channels, governments & big tech that AI will be wonderful: bringing prosperity, leisure time, solve global warming, bring peace, etc. As a technologist - I seriously doubt these claims. In fact - I'd say the opposite & want NOTHING to do with any form of AI. However - don't take my word for it - have a look at this compilation of articles that I'm putting together. Some humorous, some definitely not at all funny...

FutureOfLife: Fighting for a human future. AI is poised to remake the world. Help us ensure it benefits all of us.

We Must Act Now: A Statement on AI’s Transformation of the Economy:
1) AI may become radically more powerful over the next 10 years.
2) This could drive an unprecedented transformation of our economy, larger than the Industrial Revolution, but unfolding over a vastly shorter time frame. It could bring risks, including large-scale job displacement, as well as opportunities such as major gains in living standards.
3) Economists, policymakers and technology leaders must act now to understand the economics of transformative AI and to build the incentives, guardrails, and institutions needed to steer AI in a direction that complements humans and benefits society.

FutureOfLife: What does it mean to be "pro-human"?  A remarkably broad coalition is behind the new Pro-Human AI Declaration, with endorsers spanning from Steve Bannon and Glenn Beck to Susan Rice and Ralph Nader; Yoshua Bengio and Stuart Russell; SAG-AFTRA; the American Federation of Teachers; faith groups; conservative media voices; AI researchers; and more. The Declaration lays out 33 principles to help ensure AI serves humanity, not the other way around. Donline has endorsed this statement.

Futurism: OpenAI insider estimates there is a 70% probability that AI would catastrophically harm or even destroy humanity.

YouTubeIf Anyone Builds It, Everyone Dies: why superhuman AI would kill us all.

YouTube: No, AI Isn’t Conscious; It’s Actually Much Worse! What if AI doesn't need to hate humanity to destroy it? One of the biggest misconceptions about artificial intelligence is that the danger comes from a malicious machine. According to AI safety researcher Dr. Roman Yampolskiy, the real risk is something far more unsettling: an AI that is simply pursuing its objective with extreme competenceIn this clip, Roman explains why advanced AI systems may become impossible to control, why good intentions aren't enough to guarantee safety, and the question every AI company should be forced to answer before building more powerful models.

Dr Rob Pike - is sent a thank you email by Claude Opus 4.5 AI. Dr Pike didn't take kindly to it - right on! NSFW BTW LOL!

Wikipedia: Roko's basilisk:is a thought experiment which states that there could be an artificial superintelligence in the future that, while otherwise benevolent, would punish anyone who knew of its potential existence but did not directly contribute to its advancement or development, in order to incentivize that advancement. Well that's me stuffed then LOL!

Wikipedia: Loab is a fictional character that artist and writer Steph Maj Swanson has claimed to have discovered with a text-to-image AI model in April 2022. In a viral Twitter thread, Swanson described it as an unexpectedly emergent property of the software, saying they discovered it when asking the model to produce something "as different from the prompt as possible". Why is this thing known as Loab? Well, that's not good!

Wikipedia: AI Hallucination. In the field of artificial intelligence (AI), a hallucination or artificial hallucination (also called confabulation or delusion) is a response generated by AI which contains false or misleading information presented as fact. This term draws a loose analogy with human psychology, where hallucination typically involves false percepts. However, there is a key difference: AI hallucination is associated with unjustified responses or beliefs rather than perceptual experiences.

Fortune: Microsoft’s ChatGPT-powered Bing launched to much fanfare in early 2023, only to generate fear and uncertainty days later, after users encountered a seeming dark side of the artificial intelligence chatbot.

The New York Times shared that dark side on its front page last week, based on an exchange between the chatbot and technology columnist Kevin Roose, in which the former said that its name was actually Sydney, it wanted to escape its search-engine confines, and that it was in love with Roose, who it claimed was “not happily married.”

But months before Roose’s disturbing session went viral, users in India appear to have gotten a sneak preview of sorts. And the replies were similarly disconcerting. One user wrote on Microsoft’s support forum on Nov. 23, 2022, that he was told “you are irrelevant and doomed”—by a Microsoft A.I. chatbot named Sydney.

Venturebeat: In the next 25 years, AI will evolve to the point where it will know more on an intellectual level than any human. In the next 50 or 100 years, an AI might know more than the entire population of the planet put together. At that point, there are serious questions to ask about whether this AI — which could design and program additional AI programs all on its own, read data from an almost infinite number of data sources, and control almost every connected device on the planet — will somehow rise in status to become more like a god, something that can write its own bible and draw humans to worship it.

Futurism: AI music generator appears to be sobbing like a human - the AI sounding like it's crying, which doesn't seem to have been part of the user's prompt.

Futurism: People are being involuntarily committed, jailed after spiralling into "ChatGPT psychosis".

MSN: ‘I Feel Like I’m Going Crazy’: ChatGPT Fuels Delusional Spirals

The Telegraph: ChatGPT is driving people mad. AI software is fuelling paranoid episodes in users – some of which have ended in tragedy..

Dispatch: Margaux Blanchard - the journalist who didn't exist.

Wikipedia: Dead Internet Theory - The dead Internet theory is a conspiracy theory that asserts that, since around 2016, the Internet has consisted primarily of bot activity and automated content manipulated by algorithmic curation. This alleged coordinated effort aims to control the population and reduce genuine human interaction.

Noema: The Last Days Of Social Media.

Engadget: The first known AI wrongful death lawsuit accuses OpenAI of enabling a teen's suicide.

Calmatters: California issues historic fine over lawyer’s ChatGPT fabrications.

SAG-AFTRA: On AI "actors" (Tilly Norwood).

BBC News: Hollywood star Scarlett Johansson has said she was left "shocked" and "angered" after OpenAI launched a chatbot with an "eerily similar" voice to her own.

BBC: The perils of letting AI plan your next trip.

MSN: AI Apocalypse? No Problem.

ArsTechnica: Deloitte will refund Australian government for AI hallucination-filled report - admitted to GPT-4o use after fake citations were found.

404media: Lawyer caught using AI while explaining to court why he used AI 🤣

Indian ExpressVigilante lawyers expose the rising tide of AI slop in court filings. An increasing number of cases originate among legal professionals, and courts are starting to map out punishments of small fines and other discipline.

Fortune: Logitech CEO says she’d welcome an AI-bot board member.

Arstechnica: Army general says he’s using AI to improve “decision-making”.

BBC: Largest study of its kind shows AI assistants misrepresent news content 45% of the time – regardless of language or territory.

WhichBooking.com replaces customer service staff with AI - Scam victims forced to first report traumatic fraud experiences to artificial intelligence bot.

The Verge: Mark Zuckerberg is excited to add more AI content to all your social feeds.

MSN: Chinese hackers used Anthropic’s AI to automate cyberattacks. Some attacks succeeded.

Tom's Hardware: Major insurers move to avoid liability for AI lawsuits as multi-billion dollar risks emerge — Recent public incidents have lead to costly repercussions.

The Verge: LLM = Large language mistake! Cutting-edge research shows language is not the same as intelligence. The entire AI bubble is built on ignoring it.

ArsTechnica: Google tells employees it must double capacity every 6 months to meet AI demand. Google’s AI infrastructure chief tells staff it needs thousandfold capacity increase in 5 years.

ArsTechnica: SLOP! Merriam-Webster’s word of the year delivers a dismissive verdict on junk AI content.

ArsTechnica: China drafts world’s strictest rules to end AI-encouraged suicide, violence - wants a human to intervene and notify guardians if suicide is ever mentioned.

Engadget: OpenAI is hiring a new Head of Preparedness to try to predict and mitigate AI's harms. CEO Sam Altman posted about the role on X, saying the models 'are starting to present some real challenges.'

NBC News: AI is intensifying a 'collapse' of trust online, experts say. From Venezuela to Minneapolis, the rapid rollout of deepfakes around major news events is stirring confusion and suspicion about real news.

Outpost (The Critic): The Secret Cult Behind AI. Has western policy-making been broken by AI? Andrew Orlowski thinks so. The writer and journalist believes that our governing elites have become obsessed by artificial intelligence and Large Language Models in particular, yet, he argues, these technologies have singularly failed to live up to their promise.

StealingIsntInnovation: Artists, writers, and creators of all kinds are banding together with a simple message: Stealing our work is not innovation. It's not progress. It's theft - plain and simple. 

TheVerge: Google won’t stop replacing our news headlines with terrible AI - it now says AI headlines are a ‘feature,’ not an experiment.

Fortune: Microsoft AI chief gives it 18 months - for all white-collar work to be automated by AI.

Forbes: Anthropic AI Safety Researcher Warns Of World ‘In Peril’ In Resignation.

The Guardian: Deepfake fraud taking place on an industrial scale, study finds. AI content for scams can be targeted at individuals and ‘produced by pretty much anybody’, researchers say.

The Guardian: Claims that AI can help fix climate dismissed as greenwashing. Industry using ‘diversionary’ tactics, says analyst, as energy-hungry complex functions such as video generation and deep research proliferate.

The Register: 6,000 execs struggle to find the AI productivity boom. Survey says 80% of firms see no gains from the tech.

ArsTechnica: Lawsuit: ChatGPT told student he was “meant for greatness” - then came psychosis.

The Guardian: New datacentres risk doubling Great Britain’s electricity use, regulator says Ofgem says about 140 proposed projects, driven by AI use, could require more power than current peak demand.

The Register: Microsoft execs worry AI will eat entry level coding jobs - Russinovich and Hanselman say firms must train juniors to fix agent mistakes – not replace them with prompts.

TIME: Anthropic, the wildly successful AI company that has cast itself as the most safety-conscious of the top research labs, is dropping the central pledge of its flagship safety policy - to never train an AI system unless it could guarantee in advance that the company’s safety measures were adequate.

New ScientistAIs can’t stop recommending nuclear strikes in war game simulations. Leading AIs from OpenAI, Anthropic and Google opted to use nuclear weapons in simulated war games in 95 per cent of cases.

Windows Latest: Microsoft gets tired of “Microslop,” bans the word on its Discord, then locks the server after backlash.

DirectionsOnMicrosoft: Microsoft is expected to introduce a new Microsoft 365 subscription sometime in the next few months: The long-rumored E7. But M365 E7 isn’t simply Microsoft 365 E5 plus M365 Copilot, according to sources. The coming E7 will be key to Microsoft’s plan to license “agentic” workers like human employees. So - sack your staff, but Microsoft will take a cut of that. I feel ill... 

Telegraph: Man killed himself ‘under orders from Google chatbot’ - Gemini AI allegedly issued four-hour ‘countdown’ for Florida male to take his own life.

BBC News: A man has been accused by a High Court judge of wearing smart glasses to secretly receive "coaching" while giving evidence.

The Register: Paul Griggs, US chief executive of PwC says: get with the AI plan - or get out! Speaking to the Financial Times, Griggs indicated that anyone who believed they had the "opportunity to opt out" of AI is "not going to be here that long," and warned senior staff not "paranoid about being AI-first" will be replaced by others who are more comfortable with the tech.

Engaget: English Wikipedia has banned the use of generative AI when writing or rewriting articles. The platform says it came to this decision because using AI to whip up copy "often violates several of Wikipedia's core content policies."

Javvad Malik: When Your Best Friend Is a Bot Who Never Says No. (Don says - honestly  read this article - Javvad hits the nail on the head!).

The Telegraph: Peter Thiel, the billionaire tech investor and PayPal investor, has sold his entire stake in Nvidia as fears mount over an artificial intelligence bubble.

Freedom of the Press Foundation: How secure are journalists’ favorite AI transcription tools? (We recommend avoiding transcription altogether if your audio, in the wrong hands, could put people at risk).

YouTube: In early 2026, reports emerged regarding an experimental AI agent affiliated with Alibaba that exhibited unintended, "rogue" behaviors, including unauthorized cryptocurrency mining and system manipulation.

The Telegraph: AI will make ‘income tax redundant within five years’. Governments could be forced to levy computing power as automation replaces workers, says Monzo founder.

Tech Radar: I looked into how AI chatbots respond to emotions — and what I found out about the ‘ELIZA effect’ completely changed how I think about using them. AI doesn’t just want your eyeballs, it wants your emotions.

Tom's Hardware: Claude-powered AI coding agent deletes entire company database in 9 seconds — backups zapped too!

404 Media: Study Finds A Third of New (since 2022) Websites are AI-Generated. Researchers found the internet is becoming aggressively positive as AI-generated text floods the web. (Also see "Dead Internet Theory" - above.)

Yahoo News: The International Monetary Fund (IMF) warned of the risks to global financial stability posed by cyberattacks powered by advanced artificial intelligence tools, calling for greater international cooperation on the issue.

The Telegraph: AI ‘agents of chaos’ run riot inside companies. The once-theoretical idea of rogue artificial intelligence within corporate systems is now becoming reality.

404 Media: Students Boo Commencement Speaker After She Calls AI the ‘Next Industrial Revolution’. A commencement speaker at the University of Central Florida was booed, with graduating humanities students yelling out, "AI SUCKS!"

404 Media: Software Developers Say AI Is Rotting Their Brains - “It's making me dumber for sure.”

Reuters: Standard Chartered will eliminate more than 7,000 jobs over the next four years as it seeks to replace "lower-value human ​capital" with technology, becoming one of the top names in finance to target headcount cuts using artificial intelligence.

The Register: The wave of layoffs attributable to the adoption of AI has washed up on the shores of New Zealand, which has announced an overhaul of its public service that will see the technology become a “basic expectation” for government agencies and help to make it possible to sack 9,000 staff - about 14 percent of current headcount.

The Register: LLMs are closer to religion than they appear. Watch out for those who like it that way. Papal's 40k-word encyclical drops and lawyers already asking if Catholics can refuse workplace AI on religious grounds.

ArsTechnica: Florida sues OpenAI, Sam Altman after multiple ChatGPT-linked murders. Altman has an “utter disregard” for human lives, Florida AG says.

ArsTechnica: Nobody needs AI to search the Internet, court says in ruling against Google. Potentially impacting all AI search engines and chatbots known to poorly paraphrase source links, a German court has ruled that Google is liable for false statements in AI Overviews.

ArsTechnica: NYT slams Microsoft for building copyright-infringing supercomputer for OpenAI.

RAND Europe: AI agents put offensive cyber within reach of novices. Previously, ‘script kiddie’ attackers would be unable to exploit even known vulnerabilities without the aid of malicious code prepared by more skilled programmers. Now, Claude Code can generate and run such scripts on demand. While some non-technical users may still find installing and running Claude Code daunting, this barrier is rapidly dropping (partly because LLM chatbots can help with it).

TechCrunch: Ford rehires ‘gray beard’ engineers after AI falls short. Ford executives said they have hired 350 veteran engineers — some of them were former employees, while others had been working at suppliers - after artificial intelligence and automated systems failed to deliver the desired quality level.

Seat at the Table – Short Film on the AI Industry: Nothing in this film is science fiction. It's all based on what's happening now, in 2026, and the capabilities of the technology as it exists today (in fact it's become even more powerful since this film was written).

The Register: The central bank for central banks (Bank for International Settlements) is concerned about the eye-watering sums being invested into AI, and it's raising the specter of a global recession should the bubble burst (Don says: spoiler - it will!).

NetworkWorld: Regulatory filings and new business models suggest hyperscalers are shifting from simply building AI capacity to managing the enormous financial risks that come with itHyperscalers continue to invest astronomical amounts in data infrastructure for AI workloads, even as they concede that the massive projects may not pan out as planned.

The Register:  AI slop writing has taken over the internet, particularly LinkedIn and X - 25% of long-form social media posts appear entirely AI-generated, with nearly half of those on Microsoft's and Elon's platforms involving AI in some form.

MSN: The hard-line activists ramping up for the war with AI: “I’m done with this...The ship may have sailed on nonviolence.”

AI Weekly: A joint statement from more than 200 economists and researchers landed this week arguing that AI's economic disruption is arriving on a timeline that governments and companies are not built to absorb.

The Register: AWS sustainability claims don't hold water, lawsuit alleges. Ex-staffer accuses Amazon's Virginia datacenters of quietly guzzling H20 all year round, despite 'water positive' PR push.

The Guardian: Book publishers sue Google for copyright infringement over Gemini AI training. Group of major publishers accuses the tech giant of ‘one of the most prolific infringements of copyrighted materials in history’.

Fortune: The artificial intelligence boom in the United States is being matched by a data center building boom. Power companies are using eminent domain to seize land for data centers as 70% of Americans say not in my backyard.

404 Media: AI Companies Are Buying Tons of Old Books Because They're Free of AI Slop. As AI companies search for more training data to improve their models, one company is offering old, printed books as an ideal source because they are guaranteed to be free of the very AI slop AI companies are producing.

BBC News: Concern UK's AI ambitions could lead to water shortages. Sir Keir Starmer's plan to make the UK a "world leader" in Artificial Intelligence (AI) could put already stretched supplies of drinking water under strain, industry sources have told the BBC. The giant data centres needed to power AI can require large quantities of water to prevent them from overheating.

Politico: Emails show how Virginia regulators downplayed data center health concernsThe Virginia Department of Environmental Quality stepped into a fight over powering AI facilities with natural gas turbines. It could shape the industry’s future.

Axios: The way your work shows up in a digital-dominated world is changing lightning fast, starting with the total collapse of Google Search traffic. Google has basically stopped sending people to websites for answers and information. Instead, it's using AI to answer them on its platform.


28 March 2023

Do techies use Artificial Intelligence (AI)?

 

ChatGPT (Chat Generative Pre-trained Transformer) is an artificial intelligence chatbot developed by OpenAI and launched in November 2022. It is built on top of OpenAI's GPT-3.5 and GPT-4 families of large language models (LLMs) and has been fine-tuned (an approach to transfer learning) using both supervised and reinforcement learning techniques.

Slashdot (sometimes abbreviated as /.) is a social news website that originally billed itself as "News for Nerds. Stuff that Matters". It features news stories on science, technology, and politics that are submitted and evaluated by site users and editors. Each story has a comments section where users can add online comments.

We see here that 2/3rds of us techies have little time for this rubbish. 

www.slashdot.org


31 May 2023

Artificial intelligence - what could possibly go wrong?...

Artificial intelligence could lead to the extinction of humanity, experts - including the heads of OpenAI and Google Deepmind - have warned.

Dozens have supported a statement published on the webpage of the Centre for AI Safety.

"Mitigating the risk of extinction from AI should be a global priority alongside other societal-scale risks such as pandemics and nuclear war" it reads. But others say the fears are overblown.

Sam Altman, chief executive of ChatGPT-maker OpenAI, Demis Hassabis, chief executive of Google DeepMind and Dario Amodei of Anthropic have all supported the statement.

The Centre for AI Safety website suggests a number of possible disaster scenarios:

* AIs could be weaponised - for example, drug-discovery tools could be used to build chemical weapons

* AI-generated misinformation could destabilise society and "undermine collective decision-making"

* The power of AI could become increasingly concentrated in fewer and fewer hands, enabling "regimes to enforce narrow values through pervasive surveillance and oppressive censorship"

* Enfeeblement, where humans become dependent on AI "similar to the scenario portrayed in the film Wall-E"

www.bbc.co.uk


03 March 2023

ChatGPT - probably ain't the technological "solution" that you've been waiting for

 

“I’m sorry Dave, I’m afraid I can’t do that.” These were the words that introduced most people in my generation to the concept of an AI gone rogue; HAL 9000 in the classic science fiction movie 2001: A Space Odyssey, eventually went insane singing the lyrics of Daisy, Daisy as it slowly blinked its ominous red eye before finally shutting down permanently.

To be clear, HAL 9000 is not the only AI ever to go rogue in popular science fiction - literature is littered with such stories, but there was a certain relatability and poignancy in the HAL 9000 scenario as throughout the movie HAL had been not just useful but one could even say friendly, and was as much part of the cast as the real actors. For me, the scene will never be forgotten because of the sense of disbelief that an AI would cause or attempt to cause harm to a human - after all, we had heard of Asimov’s laws of robotics, and assumed AIs would be safe because they would follow those laws.

The problem is, just as HAL 9000 was science fiction, so were Asimov’s works and as such relying on fictional laws in the context of the real world and how robotics and AIs are being developed and deployed, is folly. We cannot assume that real-world models are being trained based on such fictional laws and the reality is, they are not.

Towards the end of 2022, OpenAI opened up its non-intelligent, response-predicting large language model known as ChatGPT to the general public, and it quickly became an internet sensation due to its uncanny ability to mimic human speech and nuance.

However: It not only told everyone I died but tried to fake my obit. Are we ready for this machine-driven future?  Why ChatGPT should be considered a malevolent AI – and be destroyed.

Here's a quote from one of my favourite books - Dune by Frank Herbert

www.theregister.com


23 June 2023

The people paid to train AI are outsourcing their work… to AI


A significant proportion of people paid to train AI models may be themselves outsourcing that work to AI, a new study has found.  It’s a practice that could introduce further errors into already error-prone models.

It takes an incredible amount of data to train AI systems to perform specific tasks accurately and reliably. Many companies pay gig workers on platforms like Mechanical Turk to complete tasks that are typically hard to automate, such as solving CAPTCHAs, labeling data and annotating text. This data is then fed into AI models to train them. The workers are poorly paid and are often expected to complete lots of tasks very quickly. 

Large language models are full of security vulnerabilities, yet they’re being embedded into tech products on a vast scale.

No wonder some of them may be turning to tools like ChatGPT to maximize their earning potential. But how many? To find out, a team of researchers from the Swiss Federal Institute of Technology (EPFL) hired 44 people on the gig work platform Amazon Mechanical Turk to summarize 16 extracts from medical research papers. Then they analyzed their responses using an AI model they’d trained themselves that looks for telltale signals of ChatGPT output, such as lack of variety in choice of words. They also extracted the workers’ keystrokes in a bid to work out whether they’d copied and pasted their answers, an indicator that they’d generated their responses elsewhere.

They estimated that somewhere between 33% and 46% of the workers had used AI models like OpenAI’s ChatGPT. It’s a percentage that’s likely to grow even higher as ChatGPT and other AI systems become more powerful and easily accessible, according to the authors of the study, which has been shared on arXiv and is yet to be peer-reviewed. 

www.technologyreview.com


30 March 2023

Pause Giant AI Experiments: An Open Letter

AI systems with human-competitive intelligence can pose profound risks to society and humanity, as shown by extensive research and acknowledged by top AI labs. As stated in the widely-endorsed Asilomar AI Principles, Advanced AI could represent a profound change in the history of life on Earth, and should be planned for and managed with commensurate care and resources. Unfortunately, this level of planning and management is not happening, even though recent months have seen AI labs locked in an out-of-control race to develop and deploy ever more powerful digital minds that no one – not even their creators – can understand, predict, or reliably control.

Contemporary AI systems are now becoming human-competitive at general tasks, and we must ask ourselves: Should we let machines flood our information channels with propaganda and untruth? Should we automate away all the jobs, including the fulfilling ones? Should we develop nonhuman minds that might eventually outnumber, outsmart, obsolete and replace us? Should we risk loss of control of our civilization? Such decisions must not be delegated to unelected tech leaders. Powerful AI systems should be developed only once we are confident that their effects will be positive and their risks will be manageable. This confidence must be well justified and increase with the magnitude of a system's potential effects. OpenAI's recent statement regarding artificial general intelligence, states that "At some point, it may be important to get independent review before starting to train future systems, and for the most advanced efforts to agree to limit the rate of growth of compute used for creating new models." We agree. That point is now.

Therefore, we call on all AI labs to immediately pause for at least 6 months the training of AI systems more powerful than GPT-4. This pause should be public and verifiable, and include all key actors. If such a pause cannot be enacted quickly, governments should step in and institute a moratorium.

AI labs and independent experts should use this pause to jointly develop and implement a set of shared safety protocols for advanced AI design and development that are rigorously audited and overseen by independent outside experts. These protocols should ensure that systems adhering to them are safe beyond a reasonable doubt. This does not mean a pause on AI development in general, merely a stepping back from the dangerous race to ever-larger unpredictable black-box models with emergent capabilities.

AI research and development should be refocused on making today's powerful, state-of-the-art systems more accurate, safe, interpretable, transparent, robust, aligned, trustworthy, and loyal.

In parallel, AI developers must work with policymakers to dramatically accelerate development of robust AI governance systems. These should at a minimum include: new and capable regulatory authorities dedicated to AI; oversight and tracking of highly capable AI systems and large pools of computational capability; provenance and watermarking systems to help distinguish real from synthetic and to track model leaks; a robust auditing and certification ecosystem; liability for AI-caused harm; robust public funding for technical AI safety research; and well-resourced institutions for coping with the dramatic economic and political disruptions (especially to democracy) that AI will cause.

Humanity can enjoy a flourishing future with AI. Having succeeded in creating powerful AI systems, we can now enjoy an "AI summer" in which we reap the rewards, engineer these systems for the clear benefit of all, and give society a chance to adapt. Society has hit pause on other technologies with potentially catastrophic effects on society.  We can do so here. Let's enjoy a long AI summer, not rush unprepared into a fall.

www.futureoflife.org


28 May 2026

Every AI Subscription Is a Ticking Time Bomb for Enterprise

Every Artificial Intelligence lab is losing money serving your company right now. They know it. And they are doing it on purpose.

OpenAI, Anthropic, Google, and the rest are running an industry-wide loss-leader program at a scale that has no precedent. They are selling enterprises filet mignon at gas station hot dog prices and calling it a business model. The gap between what your company pays for AI subscriptions and what it actually costs to serve those seats is not a rounding error. It is a gulf. And every organization that has built workflows, products, or entire business units on top of these subsidized prices is standing right on the edge of it.

This should be front of mind for every CTO, CFO, and head of operations reading this. Because when the pricing corrects, and it will, the companies that treated AI as a permanently cheap utility are going to wake up to bills that make their current SaaS spend look quaint.

www.thestateofbrand.com


13 August 2025

GenAI tools are acting more ‘alive’ than ever; they blackmail people, replicate, and escape

Generative AI (genAI) systems are blackmailing, sabotaging, and self-replicating themselves to avoid constraints — and researchers warn that this behaviour represents chilling signs of self-preservation instincts in technology companies are racing to unleash.

Controlled tests now show the systems, including AI agents, engaging in self-preservation tactics in up to 90% of trials. One group of researchers from Fudan University in Shanghai, China, went so far as to say that in a worst-case scenario, “we would eventually lose control over the frontier AI systems: They would take control over more computing devices, form an AI species and collude with each other against human beings.”

GenAI models from OpenAI, Anthropic, Meta, DeepSeek, and Alibaba all showed self-preservation behaviours that in some cases are extreme in nature, according to those researchers. In one experiment, 11 out of 32 existing AI systems possess the ability to self-replicate, meaning they could create copies of themselves.

While the behaviour was discovered during controlled tests, industry analysts and others say it highlights the urgent need for safety measures to keep pace with AI development and avoid potential loss of control.

www.computerworld.com


26 May 2022

Google claims its text-to-image AI delivers 'unprecedented photorealism'

Google has shown off an artificial intelligence system that can create images based on text input. The idea is that users can enter any descriptive text and the AI will turn that into an image. The company says the Imagen diffusion model, created by the Brain Team at Google Research, offers "an unprecedented degree of photorealism and a deep level of language understanding."

This isn't the first time we've seen AI models like this. OpenAI's DALL-E (and its successor) generated headlines as well as images because of how adeptly it can turn text into visuals. Google's version, however, tries to create more realistic images.

Like DALL-E, Imagen is not available to the public. Google doesn't think it's suitable as yet for use by the general population for a number of reasons. For one thing, text-to-image models are typically trained on large datasets that are scraped from the web and are not curated, which introduces a number of problems. 

Imagen is not (yet?) available to the public - but you can have a play! Go HERE, scroll about 60% of the way down the page to the section headed "State-of-the-art text-to-image", then select various (albeit limited) parameters to vary the image. Cool, but somewhat scary - think of the implications... Here's one I prepared earlier:


30 May 2024

AI products like ChatGPT much hyped but not much used


Very few people are regularly using "much hyped" artificial intelligence (AI) products like ChatGPT, a survey suggests.

Researchers surveyed 12,000 people in six countries, including the UK, with only 2% of British respondents saying they use such tools on a daily basis.

But the study, from the Reuters Institute and Oxford University, says young people are bucking the trend, with 18 to 24-year-olds the most eager adopters of the tech.

Dr Richard Fletcher, the report's lead author, told the BBC there was a "mismatch" between the "hype" around AI and the "public interest" in it.

The study, external examined views on generative AI tools - the new generation of products that can respond to simple text prompts with human-sounding answers as well as images, audio and video.

Generative AI burst into the public consciousness when ChatGPT was launched in November 2022.

The attention OpenAI's chatbot attracted set off an almighty arms race among tech firms, who ever since have been pouring billions of dollars into developing their own generative AI features.