Skip to content

Commit a42d4f7

Browse files
author
Workshop Participant
committed
Reads cache tokens from openai response
1 parent 345a147 commit a42d4f7

File tree

1 file changed

+4
-0
lines changed

1 file changed

+4
-0
lines changed

src/strands/types/models/openai.py

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -260,6 +260,10 @@ def format_chunk(self, event: dict[str, Any]) -> StreamEvent:
260260
"inputTokens": event["data"].prompt_tokens,
261261
"outputTokens": event["data"].completion_tokens,
262262
"totalTokens": event["data"].total_tokens,
263+
"cacheReadInputTokens": event["data"].prompt_tokens_details.cached_tokens,
264+
"cacheWriteInputTokens": getattr(
265+
event["data"], "cache_creation_input_tokens", 0
266+
), # litellm
263267
},
264268
"metrics": {
265269
"latencyMs": 0, # TODO

0 commit comments

Comments
 (0)