Skip to content

Commit 4cc80a3

Browse files
committed
fix: avoid undeclared gt res
1 parent f7d3cc8 commit 4cc80a3

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

bigcodebench/evaluate.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -131,14 +131,15 @@ def evaluate(flags):
131131
else:
132132
expected_time = {task_id: None for task_id in problems}
133133

134+
gt_pass_rate = np.mean([1 if v is not None else 0 for v in expected_time.values()])
135+
134136
if os.path.isfile(result_path):
135137
print(f"Load from previous results from {result_path}")
136138
with open(result_path, "r") as f:
137139
results = json.load(f)
138140

139141
results = compatible_eval_result(results)
140142
else:
141-
gt_pass_rate = np.mean([1 if v is not None else 0 for v in expected_time.values()])
142143

143144
if flags.check_gt_only:
144145

0 commit comments

Comments
 (0)