Running
12
SWE-Issue
❓
Track GitHub issue statistics for SWE agents
AI & ML interests
Software Engineering, AI Evaluation
Recent Activity
Organization Card
Software Engineering Arena is an open-source initiative to transparently evaluate and track AI coding agents across real-world software engineering tasks. We provide interactive platforms, tracking systems, and novel metrics to advance the field of AI-assisted software development.
The easier it is to verify a solution, the faster an AI system can learn to master the task. — Jason Wei¹
¹ https://www.jasonwei.net/blog/asymmetry-of-verification-and-verifiers-law
Welcome collaboration from research labs, independent contributors, and the broader SE community!
models
0
None public yet
datasets
8
SWE-Arena/leaderboard_data
Updated
•
265
•
1
SWE-Arena/review_data
Updated
•
2.02k
•
1
SWE-Arena/commit_data
Updated
•
335
•
1
SWE-Arena/issue_data
Updated
•
172
•
1
SWE-Arena/pr_data
Preview
•
Updated
•
2.85k
•
1
SWE-Arena/bot_data
Viewer
•
Updated
•
92
•
374
•
1
SWE-Arena/vote_data
Viewer
•
Updated
•
31
•
70
•
1
SWE-Arena/conversation_data
Updated
•
71
•
1