pengjunjie/ragflow
1
0
Fork 1
mirror of https://github.com/infiniflow/ragflow.git synced 2025-12-08 20:42:30 +08:00
Code Issues Packages Projects Releases Wiki Activity

TEI auto truncate inputs (#10916)

Browse Source 
### What problem does this PR solve?

TEI auto truncate inputs

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
This commit is contained in:
Zhichang Yu
2025-10-31 16:46:20 +08:00
committed by GitHub
parent f52e56c2d6
commit fe4852cb71
2 changed files with 3 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
docker/docker-compose-base.yml
View File

@ -203,7 +203,7 @@ services:
env_file: .env env_file: .env
networks: networks:
- ragflow - ragflow
command: ["--model-id", "/data/${TEI_MODEL}"] command: ["--model-id", "/data/${TEI_MODEL}", "--auto-truncate"]
restart: on-failure restart: on-failure
@ -217,7 +217,7 @@ services:
env_file: .env env_file: .env
networks: networks:
- ragflow - ragflow
command: ["--model-id", "/data/${TEI_MODEL}"] command: ["--model-id", "/data/${TEI_MODEL}", "--auto-truncate"]
deploy: deploy:
resources: resources:
reservations: reservations:

2
rag/llm/embedding_model.py
View File

@ -82,7 +82,7 @@ class BuiltinEmbed(Base):
def encode(self, texts: list): def encode(self, texts: list):
batch_size = 16 batch_size = 16
texts = [truncate(t, self._max_tokens) for t in texts] # TEI is able to auto truncate inputs according to https://github.com/huggingface/text-embeddings-inference.
token_count = 0 token_count = 0
ress = None ress = None
for i in range(0, len(texts), batch_size): for i in range(0, len(texts), batch_size):