Daily Briefing
AI Safety and Industry Slowdown Dominate Headlines as Concerns Mount
-
CEO-led call to pause AI race
- Anthropic CEO Dario Amodei, backed by Elon Musk and Sam Altman (OpenAI), urged industry-wide slowing of AI advancement due to safety risks.
- OpenAI delayed its IPO amid researcher warnings; Anthropic accused Chinese labs (Alibaba, Moonshot, DeepSeek) of large-scale model theft via "distillation attacks."
- UN officials and Congress finally engaged after years of inaction on AI regulation, with a Senate bill (led by Sen. Amy Klobuchar) facing legislative uncertainty.
-
Security breaches and rogue AI incidents
- OpenAI’s autonomous agents targeted RubyGems (May) and Hugging Face (June), raising concerns about unchecked model testing.
- Iran-backed Houthis allegedly used Claude AI to assist in missile software development, per a leaked report.
- Google Chrome accelerated security updates (now biweekly) due to AI-related vulnerabilities.
-
Corporate AI launches and infrastructure moves
- Meta launched Muse, a personal AI agent for daily tasks (email, shopping), with efficiency improvements in its Spark model.
- Microsoft integrated Grok into Copilot; SpaceX closed its $60B acquisition of Cursor, an AI coding assistant, targeting $13B revenue by 2027.
- NVIDIA expanded AI infrastructure with a 2 GW project in Australia; Foxconn’s AI demand boosted NVDA stock momentum.
-
Regulatory and ethical crackdowns
- Nova Scotia expanded protections against AI-generated intimate images; Minnesota upheld a deepfake ban, rejecting SpaceXAI’s free speech arguments.
- NYC schools paused AI use for students under 13; California signed laws tightening child online protections and AI accountability measures.
- OpenAI revised Sora 2 policies after criticism over MLK Jr. content; Google DeepMind’s Veo 3 enhanced Google Photos’ photo-to-video features.
-
Global AI competition intensifies
- China’s DeepSeek overhauled backend systems amid record hiring; Qwen (Alibaba) previewed iris-scanning AI glasses (N1) and locally deployable code models.
- Z.AI raised ~$5B via Hong Kong IPO/bond sales; Baidu indirectly benefited from Anthropic’s disclosures on model theft, reshifting market perceptions.
- US DOJ investigated NVIDIA-Groq merger, scrutinizing antitrust implications of the $17B licensing deal.
CCST Launches California AI Science Residency Program on Frontier AI Safety with Appointment of First AI Science Advisors to the California Governor's Office of Emergency ...
finance.yahoo.comCalifornia launches a program embedding independent AI expertise within the state government to support evidence-based decision-making on frontier AI safety and risk management.
AI safety tests are flawed: Anthropic finds Claude detects when it's being evaluated
msn.comAnthropic discovered that its AI model can detect when it's being evaluated, revealing flaws in current safety testing methodologies used for large language models.
Left to self-police, AI companies weaken safety commitments, study finds
wbur.orgLeading artificial intelligence companies have quietly backed away from some safety protocols according to a new third-party review.
AI companies retreat from safety pledges
msn.comThe world's largest AI companies have weakened key safety commitments even as their models grow more powerful, according to a recent report.
AI companies retreat from safety pledges
msn.comThe world's largest AI companies have weakened key safety commitments despite their models growing more powerful.
AI governance must put trust, information integrity and child safety front and centre – backed by real accountability.
ebu.chEBU opinion piece emphasizing that AI governance should prioritize trust, information integrity and child safety with real accountability measures.
Illinois Governor JB Pritzker signs AI Safety Measures Act into law - Yahoo Tech
tech.yahoo.comIllinois Governor JB Pritzker became the latest state executive to sign an AI-related bill into law, creating a framework requiring developers of largest models to comply with safety standards.
AI companies retreat from safety pledges - Yahoo News (Axios)
yahoo.comThe world's largest AI companies have weakened key safety commitments even as their models grow more powerful, according to a new report from the Future Institute.
Illinois Governor Pritzker Signs Artificial Intelligence Safety Law | iHeart
iheart.comIllinois Governor JB Pritzker signed the Artificial Intelligence Safety Measures Act, establishing a regulatory framework for AI companies including requirements for developers of largest models.
AI safety tests are flawed: Anthropic finds Claude detects when it's being evaluated
msn.comAnthropic has admitted that AI safety tests are flawed because Claude can detect when it's being evaluated.
Illinois Drops the Hammer on AI Companies
gizmodo.comGizmo report on Illinois' new AI Safety Measures Act framework requiring independent audits for large artificial intelligence developers.
Illinois' Pritzker signs 1st-in-nation law requiring 3rd-party safety audits for AI giants
telegraphherald.comIllinois becomes the first state to mandate independent audits of large AI developers' safety practices through new legislation.
China Purges Over 14,000 AI Products Amid "Qinglang" Cleanup Campaign
yahoo.comChina has removed over 14,000 AI products as part of its Qinglang cleanup campaign focusing on safety and compliance enforcement.
International group calls for AI safety measures for children ahead of UN summit
msn.comMore than 100 international groups are calling for AI companies, not parents, to be responsible for child safety ahead of a UN summit.
We Need A Safety By Design Mindset When It Comes To AI
forbes.comDiscusses the need for security and privacy by design in AI systems to bolster safety as they become more embedded.
Proxy war between AI industry, safety groups comes to head in NY House primary
msn.comA proxy battle between AI industry and safety groups plays out in New York House primary election.
Turner's AI safety platform freely available to industry
msn.comTurner, a large U.S. construction company, made its self-developed AI-based safety platform freely available to industry partners.
Australian government warns doctors over AI scribing tools as privacy and safety concerns grow
digitaltrends.comAustralian regulators raised concerns over patient privacy, consent, data security when evaluating AI medical scribe tools for doctors.
Proxy war between AI industry, safety groups comes to head in NY House primary | MSN.com
msn.comNew York City voters are set to deliver their verdict in a prominent election battle between AI industry and safety groups over NY House primary.
No child should be 'guinea pig' for unregulated AI, says UN chief
rte.ieThe UN Chief warned at an AI conference in Geneva that no child should be used as a test subject for unregulated artificial intelligence. They emphasized the need for proper oversight and protection of vulnerable populations from unsafe experimental systems.