腾讯混元联合复旦、清华发布 ExplorationBench,用可验证 Alien Worlds 评测 AI 探索能力
New Research: We are releasing ExplorationBench, a benchmark for measuring how AI systems explore. Scientific discovery begins where known problems end: a system has to frame hypotheses, design experiments, and learn from the results. Evaluating this is hard. Genuinely new answers cannot be checked quickly, and in familiar domains a model can simply recall what it has seen. Addressing this challenge, researchers from Tencent Hy, Fudan University, and Tsinghua University built verifiable Alien Worlds. Their rules are executable, so every answer is checked exactly, and they conflict with familiar knowledge, so recall alone cannot solve the tasks. 🔹 Two sandboxes: AlienCode (31 hidden rule changes, 70 tasks) and AlienLogic (24 patched inference rules, 70 theorems) 🔹 A flawed manual, four rounds of self-designed probes, and closed-book tests after every round 🔹 Every answer graded by an interpreter or a proof checker, with no LLM judge What we found across 10 frontier AI systems: 1️⃣ Ge
腾讯混元与复旦、清华的研究者发布 ExplorationBench,用可验证的 Alien Worlds 评测 AI 系统的探索能力,包含 AlienCode(31 条隐藏规则改动、70 个任务)和 AlienLogic(24 条修改的推理规则、70 个定理)两个沙盒。
粉丝 5.4万
认证:X 认证的官方组织
Tencent's foundation model for text, image, video, and 3D generation.
- 浏览
- 7万
- 点赞
- 429
- 评论
- 13
- 分享
- 44
- 收藏
- 195
约为这个来源平时的 3.2 倍
数字来自平台,为最近一次抓取时的数据。
来源:X · 腾讯混元 · x.com