1333d3c02a
Fix: float transfer exception. ( #6197 )
...
### What problem does this PR solve?
#6177
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-03-18 11:13:44 +08:00
fabc5e9259
Refa: fix re-rank scope. ( #6152 )
...
### What problem does this PR solve?
#6140
### Type of change
- [x] Refactoring
2025-03-17 13:26:29 +08:00
e5a8b23684
Fix: empty tag field issue. ( #6103 )
...
### What problem does this PR solve?
#6102
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-03-14 17:35:57 +08:00
485bc7d7d6
Fix: limit the depth of DFS ( #6101 )
...
### What problem does this PR solve?
#6085
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-03-14 17:10:38 +08:00
e05cdc2f9c
Fix: encode detect error. ( #6006 )
...
### What problem does this PR solve?
#5967
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-03-13 10:47:58 +08:00
15736c57c3
Fix: empty query issue. ( #5830 )
...
### What problem does this PR solve?
#5214
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-03-10 13:56:56 +08:00
c190086707
Fix: bad case for tokenizer. ( #5543 )
...
### What problem does this PR solve?
#5492
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-03-03 15:36:16 +08:00
4f40f685d9
Code refactor ( #5371 )
...
### What problem does this PR solve?
#5173
### Type of change
- [x] Refactoring
2025-02-26 15:40:52 +08:00
53b9e7b52f
Add tavily as web searh tool. ( #5349 )
...
### What problem does this PR solve?
#5198
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2025-02-26 10:21:04 +08:00
daddfc9e1b
Remove dup gb2312, solve currupt error. ( #5326 )
...
### What problem does this PR solve?
#5252
#5325
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-02-25 12:22:37 +08:00
3444cb15e3
Refine search query. ( #5235 )
...
### What problem does this PR solve?
#5173
#5214
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-02-21 18:32:32 +08:00
cdb3e6434a
Fix empty question issue. ( #5225 )
...
### What problem does this PR solve?
#5241
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-02-21 15:47:39 +08:00
7b3d700d5f
Apply agentic searching. ( #5196 )
...
### What problem does this PR solve?
#5173
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2025-02-20 17:41:01 +08:00
e6c024f8bf
Fix too many clause while searching. ( #5119 )
...
### What problem does this PR solve?
#5100
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-02-19 13:18:39 +08:00
29a59ed7e2
Fix: Use self.dataStore.indexExist in all_tags method of Dealer ( #5108 )
...
### What problem does this PR solve?
This PR fixes an AttributeError in the all_tags method of the Dealer
class. Previously, the method incorrectly called
self.docStoreConn.indexExist instead of self.dataStore.indexExist. Since
self.docStoreConn was never set (and self.dataStore is already
initialized in init), this resulted in an error when attempting to check
if the index exists. This change ensures that the proper connector is
used for the index existence check, thereby resolving the issue._
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-02-19 11:50:57 +08:00
9ff825f39d
Ignore exceptions when no index ahead. ( #5047 )
...
### What problem does this PR solve?
### Type of change
- [x] Refactoring
2025-02-18 09:09:22 +08:00
9bcccadebd
Remove use of eval() from search.py ( #4887 )
...
Use `json.loads()` instead.
### What problem does this PR solve?
Using `eval()` can lead to code injections. I think this loads a JSON
field, right? If yes, why is this done via `eval()` and not
`json.loads()`?
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-02-12 13:15:38 +08:00
f374dd38b6
Fix divided by zero issue. ( #4784 )
...
### What problem does this PR solve?
#4779
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-02-08 10:36:26 +08:00
448fa1c4d4
Robust for abnormal response from LLMs. ( #4747 )
...
### What problem does this PR solve?
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-02-06 17:34:53 +08:00
6f2c3a3c3c
Fix too long query exception. ( #4729 )
...
### What problem does this PR solve?
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-02-06 10:11:52 +08:00
4011c8f68c
Fix potential error. ( #4650 )
...
### What problem does this PR solve?
#4622
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-01-26 12:38:32 +08:00
86892959a0
Rebuild graph when it's out of time. ( #4607 )
...
### What problem does this PR solve?
#4543
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
- [x] Refactoring
2025-01-23 17:26:20 +08:00
dd0ebbea35
Light GraphRAG ( #4585 )
...
### What problem does this PR solve?
#4543
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2025-01-22 19:43:14 +08:00
c5da3cdd97
Tagging ( #4426 )
...
### What problem does this PR solve?
#4367
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2025-01-09 17:07:21 +08:00
d9a4e4cc3b
Fix page size error. ( #4401 )
...
### What problem does this PR solve?
#4400
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-01-07 19:06:31 +08:00
f948c0d9f1
Clean query. ( #4259 )
...
### What problem does this PR solve?
#4239
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-12-27 14:25:03 +08:00
7e063283ba
Removing invisible chars before tokenization. ( #4233 )
...
### What problem does this PR solve?
#4223
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-12-26 11:48:16 +08:00
321e9f3719
fix: stop rerank by model when search result is empty ( #4203 )
...
### What problem does this PR solve?
stop rerank by model when search result is empty, otherwise rerank may
raise an error (qwen).
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
Co-authored-by: 刘博 <liubo@ynby.cn >
2024-12-24 14:33:46 +08:00
c373dba0bc
Fix raptor bug. ( #4192 )
...
### What problem does this PR solve?
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-12-23 18:59:48 +08:00
31d67c850e
Fetch chunk by batches. ( #4177 )
...
### What problem does this PR solve?
#4173
### Type of change
- [x] Performance Improvement
2024-12-23 12:12:15 +08:00
50c2b9d562
Refactor trie load and construct ( #4083 )
...
### What problem does this PR solve?
1. Fix initial build and load trie
2. Update comment
### Type of change
- [x] Refactoring
Signed-off-by: jinhai <haijin.chn@gmail.com >
2024-12-18 12:52:56 +08:00
000cd6d615
Fix position lost issue. ( #4068 )
...
### What problem does this PR solve?
#4040
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-12-17 16:31:58 +08:00
68d46b2a1e
Fix bug in hierarchical_merge function ( #4006 )
...
### What problem does this PR solve?
Fix hierarchical_merge function. From idx vs. actual value to actual
value vs. actual value.
Related issue #4003
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
Co-authored-by: luopan <luopan@example.com >
2024-12-13 08:50:58 +08:00
03f00c9e6f
Rename page_num_list, top_list, position_list ( #3940 )
...
### What problem does this PR solve?
Rename page_num_list, top_list, position_list to page_num_int, top_int,
position_int
### Type of change
- [x] Refactoring
2024-12-10 16:32:58 +08:00
927873bfa6
Fix syn error. ( #3953 )
...
### What problem does this PR solve?
Close #3696
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-12-10 10:54:54 +08:00
7a6bf4326e
Fixed log not displaying ( #3946 )
...
### What problem does this PR solve?
Fixed log not displaying
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-12-10 09:36:59 +08:00
0d68a6cd1b
Fix errors detected by Ruff ( #3918 )
...
### What problem does this PR solve?
Fix errors detected by Ruff
### Type of change
- [x] Refactoring
2024-12-08 14:21:12 +08:00
56f473b680
Feat: Add question parameter to edit chunk modal ( #3875 )
...
### What problem does this PR solve?
Close #3873
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2024-12-05 14:51:19 +08:00
1b817a5b4c
Refine synonym query. ( #3855 )
...
### What problem does this PR solve?
### Type of change
- [x] Performance Improvement
2024-12-04 17:20:12 +08:00
6657ca7cde
Change default error message to English ( #3838 )
...
### What problem does this PR solve?
As title
### Type of change
- [x] Refactoring
---------
Signed-off-by: Jin Hai <haijin.chn@gmail.com >
2024-12-04 09:34:49 +08:00
74b28ef1b0
Add pagerank to KB. ( #3809 )
...
### What problem does this PR solve?
#3794
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2024-12-03 14:30:35 +08:00
0f08b0f053
Weight up title and keywords for chunks in terms of retrieval ( #3750 )
...
### What problem does this PR solve?
### Type of change
- [x] Performance Improvement
2024-11-29 16:39:55 +08:00
43e367f2ea
Detect shape error of embedding ( #3710 )
...
### What problem does this PR solve?
Detect shape error of embedding. Close #2997
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-11-28 14:10:22 +08:00
bc701d7b4c
Edit chunk shall update instead of insert it ( #3709 )
...
### What problem does this PR solve?
Edit chunk shall update instead of insert it. Close #3679
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-11-28 13:00:38 +08:00
57208d8e53
Fix batch size issue. ( #3675 )
...
### What problem does this PR solve?
#3657
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-11-27 18:06:43 +08:00
5c59651bda
Fix the bug causing garbled text ( #3640 )
...
### What problem does this PR solve?
Fix the bug causing garbled text #3613
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
Co-authored-by: liuhua <10215101452@stu.ecun.edu.cn >
2024-11-26 12:06:56 +08:00
9f3141804f
Fix chunk enable/disable issue ( #3579 )
...
### What problem does this PR solve?
#3576
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-11-22 12:25:42 +08:00
cad341e794
Added kb_id filter to knn. Fix #3458 ( #3513 )
...
### What problem does this PR solve?
Added kb_id filter to knn. Fix #3458
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-11-20 20:53:30 +08:00
289034f36e
smooth term weight ( #3510 )
...
### What problem does this PR solve?
#3499
### Type of change
- [x] Performance Improvement
2024-11-20 20:52:51 +08:00
17a7ea42eb
fix synonym bug ( #3506 )
...
### What problem does this PR solve?
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-11-20 20:52:36 +08:00
