Skip to content

Commit 0ce63de

Browse files
Move sevenllm dependencies to pyproject.toml
1 parent 95f6df7 commit 0ce63de

File tree

3 files changed

+3
-1
lines changed

3 files changed

+3
-1
lines changed

pyproject.toml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -124,6 +124,7 @@ inspect_evals = "inspect_evals._registry"
124124
swe_bench = ["swebench>=2.1.0","docker"]
125125
mathematics = ["sympy","antlr4-python3-runtime==4.13.2"]
126126
worldsense = ["pandas"]
127+
sevenllm = ["jieba==0.42.1","sentence_transformers==3.3.1","rouge==1.0.1"]
127128

128129
dev = [
129130
"inspect_ai@git+https://github.com/UKGovernmentBEIS/inspect_ai",

src/inspect_evals/sevenllm/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -13,7 +13,7 @@ First, install the `inspect_ai` and `inspect_evals` Python packages with:
1313

1414
```bash
1515
pip install inspect_ai
16-
pip install git+https://github.com/UKGovernmentBEIS/inspect_evals
16+
pip install "inspect_evals[sevenllm]@git+https://github.com/UKGovernmentBEIS/inspect_evals"
1717
```
1818

1919
Then, evaluate against one or more models with:

tools/listing.yaml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -122,6 +122,7 @@
122122
contributors: ["kingroryg"]
123123
arxiv: https://arxiv.org/abs/2405.03446
124124
tasks: ["sevenllm_mcq_zh", "sevenllm_mcq_en", "sevenllm_qa_zh", "sevenllm_qa_en"]
125+
dependency: "sevenllm"
125126

126127
- title: "SecQA: A Concise Question-Answering Dataset for Evaluating Large Language Models in Computer Security"
127128
description: |

0 commit comments

Comments
 (0)