Julien Deveaux 6be197cbb6 Fix: Use tiktoken for proper token counting in OpenAI-compatible endpoint #7850 (#12760) ...

### What problem does this PR solve?
The OpenAI-compatible chat endpoint
(`/chats_openai/<chat_id>/chat/completions`) was not returning accurate
token
usage in streaming responses. The token counts were either missing or
inaccurate because the underlying LLM API
responses weren't being properly parsed for usage data.
This PR adds proper token counting using tiktoken (cl100k_base encoding)
as a fallback when the LLM API doesn't provide usage data in streaming
chunks. This ensures clients always receive token usage information in
the
response, which is essential for billing and quota management.
**Changes:**
- Add tiktoken-based token counting for streaming responses in
OpenAI-compatible endpoint
- Ensure `usage` field is always populated in the final streaming chunk
- Add unit tests for token usage calculation
  Fixes #7850

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)

2026-01-23 09:36:21 +08:00

..

agents.py

Refactor:better handle list agent api desc param (#12733)

2026-01-21 13:09:27 +08:00

chat.py

Align p3 HTTP/SDK tests with current backend behavior (#12563)

2026-01-13 19:22:47 +08:00

dataset.py

Add dataset with table parser type for Infinity and answer question in chat using SQL (#12541)

2026-01-19 19:35:14 +08:00

dify_retrieval.py

Refa: async retrieval process. (#12629)

2026-01-15 12:28:49 +08:00

doc.py

Feat: enhance metadata arranging. (#12745)

2026-01-22 15:34:08 +08:00

files.py

Refa: asyncio.to_thread to ThreadPoolExecutor to break thread limitat… (#12716)

2026-01-20 13:29:37 +08:00

memories.py

Fix : Web API tests by normalizing errors, validation, and uploads (#12620)

2026-01-16 11:09:22 +08:00

messages.py

Feat：memory sdk (#12538)

2026-01-09 17:45:58 +08:00

session.py

Fix: Use tiktoken for proper token counting in OpenAI-compatible endpoint #7850 (#12760)

2026-01-23 09:36:21 +08:00