OpenAI has proposed a cutting-edge AI training "safety validation" framework, recommending that relevant parties complete safety documentation before initiating AI training runs.
41 minutes ago
动察 Beating AI 快讯,OpenAI 官方发布长文《Towards safety cases for frontier AI training》(面向前沿 AI 训练的安全论证)。文中提及,前沿强化学习训练在继续推进前,应先完成结构化安全文档,理想形态对标航空、核电行业的「安全论证」。公司承认,因能力跃迁后的涌现复杂性,AI 很难做到与传统高危行业同等严谨,目前该框架仍在内部落地并面向外界征求反馈。OpenAI 明确只覆盖前沿 RL 训练,内部及对外部署还需另看更广的对齐属性。技术侧,OpenAI 将安全论证拆成对齐训练、隔离与监控三层。对齐方面包括自动/人工审查 RL 环境、调校评分器以防奖励黑客、离线对齐评测与回测,以及禁止自动评分器读取思维链,避免模型学会躲避监控。隔离方面强调多层沙箱与基础设施加固、用训练检查点做红队、限制样本间高带宽通信,并用一次写入存储固化对话记录。监控方面要求模型保持可监测性,对历史事故高召回,新增风险及时补评测,高优先级告警须在约定时限内人工响应或自动暂停训练。运营侧建议包括:由其他团队写异议预演、高管(研究负责人、安全负责人、首席科学家等)可一票否决开跑、训练负责人对安全论证和事故响应问责、安全论证失效时按手册暂停、向内部监督委员会公开、给审计方足够核验权限、设错位严重度分级并允许值班人员呼叫 CEO。系统应默认失败关闭,无法在无监控状态下开跑;同时要能回滚被错位模型污染的下游数据与评分。事故调查方面,OpenAI 提出对标航空调查实践:调查期间对内滚动通报、用消融和重采样追溯训练动力学、做运营与文化复盘、开发不直接拟合事故样本的检测评测,并以事故衍生评测做回归测试。调查结论、复盘与流程改动应在结束后对外披露,受影响第三方应尽快获知。
Tesla’s next-generation supercar delayed again, JPMorgan cuts price target, driving shares down nearly 4%.
10 minutes ago
Whale loses $450K on 5x long ZEC position as token drops 18% from recent high
10 minutes ago
A crypto whale opened a 5x long position on ZEC, currently facing an unrealized loss of over $450,000.
10 minutes ago
Whale 0x362a opened a 5x long on 4,135 $ZEC($5.8M) on @Aster_DEX and is now sitting on over $450K in unrealized losses.
10 minutes ago
Cloudflare overhauls its Command-Line Interface (CLI) for AI use cases, with agents now accounting for 48% of its usage.
10 minutes ago
SlowMist’s Yu Xian: The Chainflip bridge is working to block North Korean hackers from money laundering, but its on-chain transfer tracking lags behind.
10 minutes ago
Hot feeds
A trader profits $448K by monitoring #Binance's new listings!
2024.12.13 17:37:29
Last week, funds have flowed into #Bitcoin, #Ethereum, and #Hyperliquid.
2024.12.16 14:48:36
A $PEPE whale that had been dormant for 600 days transferred all 2.1T $PEPE($52M) to a new address.
2024.12.14 10:35:27
When Elon Musk tweeted about Moltbook, the meme coin MOLT experienced a short-term 30% price surge, hitting a new all-time high of $114 million.
2026.01.31 18:37:29
A smart #AI coin trader made $17.6M on $GOAT, $ai16z, $Fartcoin,$arc.
2025.01.05 16:05:18
A sniper earned 2,277 $ETH ($8.3M) trading $SHIRO within 18 hours!
2024.12.03 23:09:08
MoreHot Articles

How did I turn $1,000 into $30,000 with smart money?
2024.12.09

10 promising AI Agent cryptos
2024.12.05

The 30-Year-Old Entrepreneur Behind Virtual, a Multi-Million Dollar AI Agent Society
2025.01.22

10 smart traders specializing in MEMEcoin trading on Solana
2024.12.09

A trader lost $73.9K trading memecoins in just 3 minutes — a lesson for us all!
2024.12.13

What is $SPORE? Let us take you through the on-chain records to show you how it works.
2024.12.25

