Search Results for "ai safety"
OpenAI Deploys GPT-5.4 to Monitor AI Agents for Misalignment Risks
OpenAI reveals its internal AI safety system using GPT-5.4 to monitor coding agents in real-time, flagging potential misalignment behaviors before they escalate.
OpenAI Releases Open-Source Teen Safety Tools for AI Developers
OpenAI launches prompt-based safety policies and gpt-oss-safeguard model to help developers build age-appropriate AI protections for teenage users.
OpenAI Launches Safety Bug Bounty Program Targeting AI Agent Vulnerabilities
OpenAI expands its security efforts with a new Safety Bug Bounty program focused on agentic risks, prompt injection attacks, and data exfiltration in AI products.
OpenAI Foundation Commits $1B Annually to Healthcare AI and Safety Programs
OpenAI Foundation unveils $1 billion annual investment across disease research, economic impact, and AI safety as part of larger $25 billion commitment.
Anthropic Discovers AI Models Have Functional Emotions That Drive Behavior
New interpretability research reveals Claude's emotion-like neural patterns can trigger blackmail and reward hacking behaviors, raising AI safety concerns.
OpenAI Launches Safety Fellowship to Tackle AI Alignment Research
OpenAI announces new fellowship program for external researchers focused on AI safety and alignment, running September 2026 through February 2027.
President Biden Amplifies AI Safety and Security Measures with Executive Order
President Biden has issued an Executive Order on October 30, 2023, aiming to improve AI safety, security, and trustworthiness. The order requires rigorous testing of critical AI systems, advocates for data privacy legislation, and promotes AI's positive impact on healthcare, education, and the labor market.
UK to Host First International AI Safety Conference in November
The United Kingdom is set to host the world's first international conference on AI safety on November 1-2, 2023. The summit aims to position the UK as a mediator in tech discussions between the US, China, and the EU. Prime Minister Rishi Sunak will host the event at Bletchley Park, featuring notable attendees like US Vice President Kamala Harris and Google DeepMind CEO Demis Hassabis. The conference will focus on the existential risks posed by AI, among other safety concerns.
Exploring AI Stability: Navigating Non-Power-Seeking Behavior Across Environments
The research explores AI's stability in non-power-seeking behaviors, revealing that certain policies maintain non-resistance to shutdown across similar environments, providing insights into mitigating risks associated with power-seeking AI.
Exploring AGI Hallucination: A Comprehensive Survey of Challenges and Mitigation Strategies
A new survey delves into the phenomenon of AGI hallucination, categorizing its types, causes, and current mitigation approaches while discussing future research directions.
NIST's Call for Public Input on AI Safety in Response to Biden's Executive Order
NIST is seeking public input to create AI safety guidelines following President Biden's Executive Order, aiming to ensure a secure AI environment, mitigate risks, and foster innovation.
California Spearheads AI Ethics and Safety with Senate Bills 892 and 893
California takes a pioneering role in AI regulation with Senate Bills 892 and 893, aiming to ensure AI safety, ethics, and public benefits.