Skip to content

Commit 5c5528e

Browse files
authored
Fix tool call4 (#3094)
* Removing the no_tool content information. * Removing a lot of NO_TOOL shenanigans. * Update the tests.
1 parent ed46c2c commit 5c5528e

File tree

7 files changed

+511
-1659
lines changed

7 files changed

+511
-1659
lines changed

integration-tests/models/__snapshots__/test_tools_llama/test_flash_llama_grammar_tools_insufficient_information_nostream.json

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -5,20 +5,20 @@
55
"index": 0,
66
"logprobs": null,
77
"message": {
8-
"content": "I am a helpful assistant!",
8+
"content": "I'm an artificial intelligence model known as a large language model (LLM) or conversational AI",
99
"role": "assistant",
1010
"tool_calls": null
1111
}
1212
}
1313
],
14-
"created": 1741263686,
14+
"created": 1741693957,
1515
"id": "",
1616
"model": "meta-llama/Llama-3.1-8B-Instruct",
1717
"object": "chat.completion",
1818
"system_fingerprint": "3.1.2-dev0-native",
1919
"usage": {
20-
"completion_tokens": 23,
21-
"prompt_tokens": 494,
22-
"total_tokens": 517
20+
"completion_tokens": 12,
21+
"prompt_tokens": 53,
22+
"total_tokens": 65
2323
}
2424
}

0 commit comments

Comments
 (0)