Mark Chen et al.
Evaluating Large Language Models Trained on Code
HumanEval tests whether generated Python functions pass unit tests on 164 handwritten problems. These scores describe function-level correctness; they do not measure repository work or a coding agent.
ModelsModels with a result.22
Top-3 spreadPoints from first to third.4.9 pts
YearYear of release.2021
Result and price
5 of 22 results
Results
22 results#ModelResultThe score from the source.
