We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 570a4c8 commit 9ff42caCopy full SHA for 9ff42ca
ADVANCED_USAGE.md
@@ -54,7 +54,7 @@ Below are all the arguments for `bigcodebench.evaluate` for the remote evaluatio
54
- `--strip_newlines`: Whether to strip newlines, default to `False`, set to `True` to strip newlines for some model series like StarCoder2
55
- `--direct_completion`: Whether to use direct completion, default to `False`
56
- `--resume`: Whether to resume the evaluation, default to `True`, set to `False` to re-run the evaluation
57
-- `--id_range`: The range of the tasks to evaluate, default to `None`, e.g. `--id_range 10,20` will evaluate the tasks from 10 to 20
+- `--id_range`: The range of the tasks to evaluate, default to `None`, e.g. `--id_range 10-20` will evaluate the tasks from 10 to 20
58
- `--backend`: The backend to use, default to `vllm`
59
- `--base_url`: The base URL of the backend for OpenAI-compatible APIs, default to `None`
60
- `--revision`: The revision of the model with the vLLM or HF backend, default to `main`
0 commit comments