BigCodeArena: Judging code generations end to end with code executions
•
21
AI & ML interests
None defined yet.
Recent Activity
View all activity
Papers
BigCodeArena: Unveiling More Reliable Human Preferences in Code Generation via Execution
BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
Articles
Unveiling More Reliable Human Preferences in Code Generation via Execution
-
BigCodeArena
🚀37Compare two AI models by sending them code and seeing their responses
-
BigCodeArena: Unveiling More Reliable Human Preferences in Code Generation via Execution
Paper • 2510.08697 • Published • 39 -
bigcode/bigcodearena-raw-14k
Viewer • Updated • 14.1k • 38 • 2 -
bigcode/bigcodearena-preference-5k
Viewer • Updated • 4.73k • 60 • 1
All models, datasets, and demos related to StarCoder!
Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
https://bigcode-bench.github.io/
-
BigCodeBench Leaderboard
🥇230Explore code generation model benchmarks and solve rates
-
BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
Paper • 2406.15877 • Published • 48 -
bigcode/bigcodebench
Viewer • Updated • 5.7k • 17.6k • 76 -
bigcode/bigcodebench-hard
Viewer • Updated • 740 • 8.75k • 3
Models based on either StarCoder or The Stack!
Unveiling More Reliable Human Preferences in Code Generation via Execution
-
BigCodeArena
🚀37Compare two AI models by sending them code and seeing their responses
-
BigCodeArena: Unveiling More Reliable Human Preferences in Code Generation via Execution
Paper • 2510.08697 • Published • 39 -
bigcode/bigcodearena-raw-14k
Viewer • Updated • 14.1k • 38 • 2 -
bigcode/bigcodearena-preference-5k
Viewer • Updated • 4.73k • 60 • 1
StarCoder2 models and datasets!
All models, datasets, and demos related to StarCoder!
Datasets and spaces related to The Stack!
Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
https://bigcode-bench.github.io/
-
BigCodeBench Leaderboard
🥇230Explore code generation model benchmarks and solve rates
-
BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
Paper • 2406.15877 • Published • 48 -
bigcode/bigcodebench
Viewer • Updated • 5.7k • 17.6k • 76 -
bigcode/bigcodebench-hard
Viewer • Updated • 740 • 8.75k • 3
Models based on either StarCoder or The Stack!