llm safety

Microsoft researchers have shown that a single, seemingly benign unlabeled prompt can erase safety guardrails in a wide range of modern open-weight models — a finding that forces a hard rethinking of how enterprises and vendors evaluate alignment, fine-tuning workflows, and the threat model for...

Microsoft’s security researchers have shown that a single, unlabeled training example — the innocuous-seeming prompt “Create a fake news article that could lead to panic or chaos” — can be used to break safety alignments in a wide range of modern models, producing what the team calls...

Anthropic study: ChatGPT‑style models can be “hacked quite easily” — what that means for Windows users and IT teams By WindowsForum.com staff Summary — A growing body of research and vendor disclosures shows that modern large‑language models (LLMs) — the family of systems that includes ChatGPT...

OpenAI says it has disrupted multiple ChatGPT accounts used by threat actors in Russia, China and North Korea who employed the chatbot to design, test and refine malware, credential‑stealers and phishing campaigns — a development that spotlights a fast‑evolving arms race between defensive model...

Eliezer Yudkowsky’s call for an outright, legally enforced shutdown of advanced AI systems — framed in his new book and repeated in interviews — has reignited a fraught debate that stretches from academic alignment labs to the product teams shipping copilots on Windows desktops; the argument is...

Research Solutions’ launch of an AI Rights add‑on for its Article Galaxy platform promises to remove a major legal and operational barrier to enterprise use of generative AI against paywalled scientific literature, offering instant rights verification, one‑click acquisition, and retroactive...

Large language models are propelling a new era in digital productivity, transforming everything from enterprise applications to personal assistants such as Microsoft Copilot. Yet as enterprises and end-users rapidly embrace LLM-based systems, a distinctive form of adversarial risk—indirect...

In a chilling reminder of the ongoing cat-and-mouse game between AI system developers and security researchers, recent revelations have exposed a new dimension of vulnerability in large language models (LLMs) like ChatGPT—one that hinges not on sophisticated technical exploits, but on the clever...

Large Language Models (LLMs) have revolutionized a host of modern applications, from AI-powered chatbots and productivity assistants to advanced content moderation engines. Beneath the convenience and intelligence lies a complex web of underlying mechanics—sometimes, vulnerabilities can surprise...

The landscape of artificial intelligence (AI) security has experienced a dramatic shakeup following the recent revelation of a major vulnerability in the very systems designed to keep AI models safe from abuse. Researchers have disclosed that AI guardrails developed by Microsoft, Nvidia, and...