a5c03ccd4c
refine mindmap prompt ( #1808 )
...
### What problem does this PR solve?
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-08-05 15:33:44 +08:00
152072f900
Add graphrag ( #1793 )
...
### What problem does this PR solve?
#1594
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2024-08-02 18:51:14 +08:00
ac7a0d4fbf
Add ParsertType Audio ( #1637 )
...
### What problem does this PR solve?
#1514
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2024-07-22 19:17:30 +08:00
58df013722
Chat Use CVmodel ( #1607 )
...
### What problem does this PR solve?
#1230
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2024-07-19 18:36:34 +08:00
264303ba98
fix delete selected chunks display wrong ( #1612 )
...
### What problem does this PR solve?
This PR solves the problem that when you delete selected chunks, the
chunks can be deleted but Chunk Number doesn't change. Now you delete
one chunk, the Chunk Number is reduced by one, delete two chunks, the
Chunk Number is reduced by two...
#900
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
Signed-off-by: seaver <zhudan187@qq.com >
2024-07-19 16:25:50 +08:00
4df75ca84e
API: Stop parsing ( #1556 )
...
### What problem does this PR solve?
Aims to stop the process of parsing.
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2024-07-17 17:07:33 +08:00
6a5e1d597c
hide referece when disable cite ( #1535 )
...
### What problem does this PR solve?
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-07-16 16:16:19 +08:00
a5a617b7a3
fix ollama max token issue ( #1489 )
...
### What problem does this PR solve?
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-07-12 16:37:32 +08:00
dcb3fb2073
fix: use user-defined rerank model's top_k parameter when knowledge Q&A conversation ( #1396 )
...
### What problem does this PR solve?
During knowledge Q&A conversations, the user-defined rerank model's
top_k parameter was not used
#1395
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-07-08 09:25:49 +08:00
b5389f487c
API: created list_doc ( #1327 )
...
### What problem does this PR solve?
Adds the api of listing documentation.
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2024-07-01 18:15:00 +08:00
92e9320657
upgrade laws parser of docx ( #1332 )
...
### What problem does this PR solve?
### Type of change
- [x] Refactoring
2024-07-01 15:50:24 +08:00
0b90aab22c
fix: using embd which user configured at knowledgebase ( #1163 )
...
### What problem does this PR solve?
as title
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-06-19 14:44:25 +08:00
8d667d5abd
fixed: duplicate name ( #1202 )
...
### What problem does this PR solve?
Duplicate method name.
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-06-18 16:28:46 +08:00
1eb4caf02a
create list_dataset api and tests ( #1138 )
...
### What problem does this PR solve?
This PR have completed both HTTP API and Python SDK for 'list_dataset".
In addition, there are tests for it.
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2024-06-17 12:19:05 +08:00
2023fdc13e
fix file preview in file management ( #1151 )
...
### What problem does this PR solve?
fix file preview in file management
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-06-14 10:33:59 +08:00
abcd3d2469
refactor ( #1124 )
...
### What problem does this PR solve?
### Type of change
- [x] Refactoring
2024-06-12 11:02:15 +08:00
d9dc183a0e
rm wrongly uploaded py ( #1073 )
...
### What problem does this PR solve?
### Type of change
- [x] Refactoring
2024-06-06 13:49:48 +08:00
4454ba7a1e
add self-rag ( #1070 )
...
### What problem does this PR solve?
#1069
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2024-06-06 11:13:39 +08:00
1de31ca9f6
refine file select code ( #1021 )
...
### What problem does this PR solve?
#1015
### Type of change
- [x] Refactoring
2024-05-31 19:44:33 +08:00
4ec845c0a6
Add API for moving files ( #1016 )
...
### What problem does this PR solve?
Add backend API support for moving files into other directory
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2024-05-31 18:11:25 +08:00
5d2f7136dd
fix chunk modification bug ( #1011 )
...
### What problem does this PR solve?
As title.
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-05-31 15:45:11 +08:00
83803a72ee
fix ollama bug ( #999 )
...
### What problem does this PR solve?
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-05-30 18:03:36 +08:00
758eb03ccb
fix jina adding issure and term weight refinement ( #974 )
...
### What problem does this PR solve?
#724 #162
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
- [x] New Feature (non-breaking change which adds functionality)
2024-05-29 19:38:57 +08:00
614defec21
add rerank model ( #969 )
...
### What problem does this PR solve?
feat: add rerank models to the project #724 #162
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2024-05-29 16:50:02 +08:00
daa4799385
limit the system context length of conversation messages. ( #962 )
...
### What problem does this PR solve?
#951
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-05-29 10:40:07 +08:00
46454362d7
fix raptor bugs ( #928 )
...
### What problem does this PR solve?
#922
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-05-27 11:01:20 +08:00
6f99bbbb08
add raptor ( #899 )
...
### What problem does this PR solve?
#882
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2024-05-23 14:31:16 +08:00
be13429d05
Add api/list_kb_docs function and modify api/list_chunks ( #874 )
...
### What problem does this PR solve?
#717
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2024-05-22 14:58:56 +08:00
2b36283712
fix english query bug ( #840 )
...
### What problem does this PR solve?
#834
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-05-20 12:23:51 +08:00
673a28e492
fix bug of chat without stream ( #830 )
...
### What problem does this PR solve?
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-05-17 20:03:00 +08:00
b3c923da6b
add doc ids in API: completion ( #827 )
...
### What problem does this PR solve?
#808
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2024-05-17 17:51:54 +08:00
a1586e0af9
correct mismatched kb doc number ( #826 )
...
### What problem does this PR solve?
#620
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-05-17 17:27:39 +08:00
081f922ee6
0517 list chunks ( #821 )
...
### What problem does this PR solve?
#717
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2024-05-17 15:58:05 +08:00
a2a6a35e94
fix doc number miss-match issue ( #822 )
...
### What problem does this PR solve?
#620
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-05-17 15:35:09 +08:00
e73ce39b66
Add 2 embeding models from OpenAI ( #812 )
...
### What problem does this PR solve?
#810
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2024-05-17 08:51:29 +08:00
95f809187e
add stream chat ( #811 )
...
### What problem does this PR solve?
#709
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2024-05-16 20:14:53 +08:00
d6772f5dd7
add version ( #807 )
...
### What problem does this PR solve?
#709
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2024-05-16 16:17:48 +08:00
1c4e92ed35
Knowledge base search is case sensitive ( #797 )
...
### What problem does this PR solve?
#793
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-05-16 09:00:12 +08:00
d8c080ee52
fix bugs in searching file using keywords ( #780 )
...
### What problem does this PR solve?
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-05-15 12:51:57 +08:00
aa1c915d6e
support gpt-4o ( #773 )
...
### What problem does this PR solve?
#771
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2024-05-15 11:16:08 +08:00
04a9e95161
let file in knowledgebases visible in file manager ( #714 )
...
### What problem does this PR solve?
Let file in knowledgebases visible in file manager.
#162
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2024-05-11 16:04:28 +08:00
7ddb2f19be
make sure to raise exception if redis is not there ( #674 )
...
### What problem does this PR solve?
### Type of change
- [x] Refactoring
2024-05-08 15:20:45 +08:00
8d6d7f6887
fix task losting isssue ( #665 )
...
### What problem does this PR solve?
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-05-07 20:46:45 +08:00
a5aed2412f
fix bugs ( #662 )
...
### What problem does this PR solve?
Fix import error for task_service.py
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-05-07 16:41:56 +08:00
de839fc3f0
optimize srv broker and executor logic ( #630 )
...
### What problem does this PR solve?
Optimize task broker and executor for reduce memory usage and deployment
complexity.
### Type of change
- [x] Performance Improvement
- [x] Refactoring
### Change Log
- Enhance redis utils for message queue(use stream)
- Modify task broker logic via message queue (1.get parse event from
message queue 2.use ThreadPoolExecutor async executor )
- Modify the table column name of document and task (process_duation ->
process_duration maybe just a spelling mistake)
- Reformat some code style(just what i see)
- Add requirement_dev.txt for developer
- Add redis container on docker compose
---------
Co-authored-by: Kevin Hu <kevinhu.sh@gmail.com >
2024-05-07 11:43:33 +08:00
5f03a4de11
remove redis ( #629 )
...
### What problem does this PR solve?
### Type of change
- [x] Refactoring
2024-04-30 19:00:41 +08:00
8c07992b6c
refine code ( #595 )
...
### What problem does this PR solve?
### Type of change
- [x] Refactoring
2024-04-28 19:13:33 +08:00
9d60a84958
refactor code ( #583 )
...
### What problem does this PR solve?
### Type of change
- [x] Refactoring
2024-04-28 13:19:54 +08:00
038822f3bd
make cites in conversation API configurable ( #576 )
...
### What problem does this PR solve?
#566
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-04-28 11:56:17 +08:00
944776f207
fix bug about fetching file from minio ( #574 )
...
### What problem does this PR solve?
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-04-28 09:57:40 +08:00
