### What problem does this PR solve?

#917 
#915

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
This commit is contained in:
KevinHuSh
2024-05-28 11:13:02 +08:00
committed by GitHub
parent 9ffd7ae321
commit 7eee193956
5 changed files with 15 additions and 5 deletions

View File

@ -24,7 +24,7 @@ class RagTokenizer:
def loadDict_(self, fnm):
print("[HUQIE]:Build trie", fnm, file=sys.stderr)
try:
of = open(fnm, "r")
of = open(fnm, "r", encoding='utf-8')
while True:
line = of.readline()
if not line: