Skip to content

Commit 6d8968a

Browse files
Merge pull request #172 from GuyAglionby/guyaglionby-fix-hf-kwargs
Save kwargs for huggingface TGI model
2 parents 6a27330 + b27704b commit 6d8968a

File tree

1 file changed

+3
-0
lines changed

1 file changed

+3
-0
lines changed

dsp/modules/hf_client.py

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -32,6 +32,9 @@ def __init__(self, model, port, url="http://future-hgx-1", http_request_kwargs=N
3232
self.headers = {"Content-Type": "application/json"}
3333

3434
self.kwargs = {
35+
"model": model,
36+
"port": port,
37+
"url": url,
3538
"temperature": 0.01,
3639
"max_tokens": 75,
3740
"top_p": 0.97,

0 commit comments

Comments
 (0)