Refactor: improve cohere calculate total counts (#12007)

### What problem does this PR solve?

improve cohere calculate total counts

### Type of change


- [x] Refactoring
This commit is contained in:
Stephen Hu
2025-12-18 10:04:28 +08:00
committed by GitHub
parent 4dd8cdc38b
commit a63dcfed6f
2 changed files with 8 additions and 2 deletions

View File

@ -56,6 +56,12 @@ def total_token_count_from_response(resp):
except Exception:
pass
if hasattr(resp, "meta") and hasattr(resp.meta, "billed_units") and hasattr(resp.meta.billed_units, "input_tokens"):
try:
return resp.meta.billed_units.input_tokens
except Exception:
pass
if isinstance(resp, dict) and 'usage' in resp and 'total_tokens' in resp['usage']:
try:
return resp["usage"]["total_tokens"]