BigCodeArena: Judging code generations end to end with code executions
•
16
AI & ML interests
None defined yet.
Recent Activity
View all activity
Papers
BigCodeArena: Unveiling More Reliable Human Preferences in Code Generation via Execution
BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
Articles
Unveiling More Reliable Human Preferences in Code Generation via Execution
-
33
BigCodeArena
🚀Compare two AI models by sending them code and seeing their responses
-
BigCodeArena: Unveiling More Reliable Human Preferences in Code Generation via Execution
Paper • 2510.08697 • Published • 31 -
bigcode/bigcodearena-raw-14k
Viewer • Updated • 14.1k • 104 • 1 -
bigcode/bigcodearena-preference-5k
Viewer • Updated • 4.73k • 57
All models, datasets, and demos related to StarCoder!
Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
https://bigcode-bench.github.io/
-
225
BigCodeBench Leaderboard
🥇Explore and analyze code completion benchmarks
-
BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
Paper • 2406.15877 • Published • 48 -
bigcode/bigcodebench
Viewer • Updated • 5.7k • 26.3k • 72 -
bigcode/bigcodebench-hard
Viewer • Updated • 740 • 9.64k • 3
Models based on either StarCoder or The Stack!
Unveiling More Reliable Human Preferences in Code Generation via Execution
-
33
BigCodeArena
🚀Compare two AI models by sending them code and seeing their responses
-
BigCodeArena: Unveiling More Reliable Human Preferences in Code Generation via Execution
Paper • 2510.08697 • Published • 31 -
bigcode/bigcodearena-raw-14k
Viewer • Updated • 14.1k • 104 • 1 -
bigcode/bigcodearena-preference-5k
Viewer • Updated • 4.73k • 57
StarCoder2 models and datasets!
All models, datasets, and demos related to StarCoder!
Datasets and spaces related to The Stack!
Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
https://bigcode-bench.github.io/
-
225
BigCodeBench Leaderboard
🥇Explore and analyze code completion benchmarks
-
BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
Paper • 2406.15877 • Published • 48 -
bigcode/bigcodebench
Viewer • Updated • 5.7k • 26.3k • 72 -
bigcode/bigcodebench-hard
Viewer • Updated • 740 • 9.64k • 3
Models based on either StarCoder or The Stack!