Skip to content

报错 RuntimeError: Invalid UTF-8 sentence! #724

@Ech0Sakura

Description

@Ech0Sakura

ltp为4.2.0。代码如下
`

    output = self.ltp.pipeline([sentence], tasks=["cws", "pos", "dep", "srl"])
    seg = output.get("cws")[0]
    postags = output.get("pos")[0]
    arcs = output.get("dep")[0]
    roles = output.get("srl")[0]

`

结果报错:

Traceback (most recent call last):
File "E:\PycharmProjects\Llama-API-Deploy\triple_extract.py", line 190, in
triple = extractor.triples_main(row['输入文本'])
File "E:\PycharmProjects\Llama-API-Deploy\triple_extract.py", line 170, in triples_main
words, postags, child_dict_list, roles_dict, arcs = self.parser.parser_main(sentence)
File "E:\PycharmProjects\Llama-API-Deploy\triple_extract.py", line 47, in parser_main
output = self.ltp.pipeline([sentence], tasks=["cws", "pos", "dep", "srl"])
File "C:\ProgramData\Anaconda3\lib\site-packages\ltp\nerual.py", line 24, in wrapper
return func(*args, **kwargs)
File "C:\ProgramData\Anaconda3\lib\site-packages\ltp\nerual.py", line 185, in pipeline
store[task] = self.post[task](result, hidden, store, inputs, tokenized)
File "C:\ProgramData\Anaconda3\lib\site-packages\ltp\nerual.py", line 24, in wrapper
return func(*args, **kwargs)
File "C:\ProgramData\Anaconda3\lib\site-packages\ltp\nerual.py", line 282, in _cws_post
words = [self.hook.hook(t, w) for t, w in zip(inputs, words)]
File "C:\ProgramData\Anaconda3\lib\site-packages\ltp\nerual.py", line 282, in
words = [self.hook.hook(t, w) for t, w in zip(inputs, words)]
RuntimeError: Invalid UTF-8 sentence!

看全网都没有遇到这个报错。有人知道吗

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions