HumanEval Benchmark: 164 Problems, pass@1 and HumanEval+
The HumanEval benchmark scores code models on 164 Python problems by pass@1. See how its tests accept wrong code, what HumanEval+ adds and why it is saturated.
Keep reading in the app
Open the app view to save this story, compare related coverage, and continue from the same source.