### What problem does this PR solve?

issue #991

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)

---------

Co-authored-by: KevinHuSh <kevinhu.sh@gmail.com>
This commit is contained in:
Wang Baoling
2024-05-31 18:03:47 +08:00
committed by GitHub
parent fefe7124a1
commit c58a1c48eb
2 changed files with 15 additions and 1 deletions

View File

@ -386,7 +386,7 @@ def init_llm_factory():
"fid": factory_infos[7]["name"],
"llm_name": "maidalun1020/bce-reranker-base_v1",
"tags": "RE-RANK, 8K",
"max_tokens": 8196,
"max_tokens": 512,
"model_type": LLMType.RERANK.value
},
# ------------------------ DeepSeek -----------------------