Skip to content

Commit 81aca07

Browse files
committed
fix passk
1 parent e2de1ea commit 81aca07

File tree

1 file changed

+5
-1
lines changed

1 file changed

+5
-1
lines changed

bigcodebench/evaluate.py

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -205,7 +205,11 @@ def evaluate(
205205
else:
206206

207207
pass_at_k = dict()
208-
passk = list(pass_k)
208+
209+
if isinstance(pass_k, str):
210+
passk = [int(k) for k in pass_k.split(",")]
211+
else:
212+
passk = pass_k
209213

210214
if isinstance(selective_evaluate, str):
211215
selected_ids = set(selective_evaluate.split(","))

0 commit comments

Comments
 (0)