Add api for sessions and add max_tokens for tenant_llm (#3472)

### What problem does this PR solve?

Add api for sessions and add max_tokens for tenant_llm

### Type of change

- [x] New Feature (non-breaking change which adds functionality)

---------

Co-authored-by: liuhua <10215101452@stu.ecun.edu.cn>
This commit is contained in:
liuhua
2024-11-19 14:51:33 +08:00
committed by GitHub
parent 883fafde72
commit d42362deb6
21 changed files with 401 additions and 67 deletions

View File

@ -4,6 +4,7 @@ export interface IAddLlmRequestBody {
model_type: string;
api_base?: string; // chat|embedding|speech2text|image2text
api_key: string;
max_tokens: number;
}
export interface IDeleteLlmRequestBody {