CodeMMLU: A Multi-Task Benchmark for Assessing Code Understanding Capabilities of CodeLLMs
Paper
•
2410.01999
•
Published
•
10
•
4
Nghi Bui
bdqnghi
AI & ML interests
AI4Software, AI4Code, CodeLLMs, Code Generation, Autonomous Agents
Recent Activity
liked
a dataset
1 day ago
Fsoft-AIC/SWE-EVO
upvoted
a
paper
about 2 months ago
SWE-EVO: Benchmarking Coding Agents in Long-Horizon Software Evolution Scenarios
submitted
a paper
about 2 months ago
SWE-EVO: Benchmarking Coding Agents in Long-Horizon Software Evolution Scenarios
Organizations
commented
5
papers
over 1 year ago
Learning to Predict Program Execution by Modeling Dynamic Dependency on Code Graphs
Paper
•
2408.02816
•
Published
•
5
•
2
REPOEXEC: Evaluate Code Generation with a Repository-Level Executable Benchmark
Paper
•
2406.11927
•
Published
•
11
•
1
AgileCoder: Dynamic Collaborative Agents for Software Development based on Agile Methodology
Paper
•
2406.11912
•
Published
•
27
•
2
AgileCoder: Dynamic Collaborative Agents for Software Development based on Agile Methodology
Paper
•
2406.11912
•
Published
•
27
•
2