跳到正文
X · Snowflake·· 1 天前AI 评分38

Snowflake 研究:近三分之一软件工程训练任务会接受"通过测试但未修复 bug"的补丁,推出 Arctic-SWE

What happens when a coding agent gets rewarded for a patch that passes tests but doesn’t fix the bug? In Snowflake AI Research team's audit of three public software-engineering training datasets, nearly a third of standard-validated tasks accepted a plausible wrong patch. Arctic-SWE combines a stress-tested reinforcement learning recipe with curated tasks and stronger tests. Explore the failure modes and the fixes: https://t.co/hNZS33Q0CF

AI 导读

Snowflake AI Research 团队审计三个公开软件工程训练数据集后发现,近三分之一经标准验证的任务会接受看似合理但实际未修复 bug 的补丁。为此团队推出 Arctic-SWE,将经过压力测试的强化学习方案与精选任务、更严格的测试相结合。

打开原文x.com
博主

粉丝 6.6万

The AI Data Cloud where data does more, and proud to be the Official Data Collaboration Provider for LA28 and Team USA.

互动数据
浏览
2049
点赞
17
评论
5
分享
2
收藏
7

约为这个来源平时的 2.3 倍

数字来自平台,为最近一次抓取时的数据。

来源:X · Snowflake · x.com