瀏覽代碼

fix dev/reformat (#2542)

Co-authored-by: jyong <jyong@dify.ai>
tags/0.5.7
Jyong 1 年之前
父節點
當前提交
b03bbab5ad
No account linked to committer's email address
共有 1 個文件被更改,包括 3 次插入4 次删除
  1. 3
    4
      api/core/splitter/fixed_text_splitter.py

+ 3
- 4
api/core/splitter/fixed_text_splitter.py 查看文件

from core.model_runtime.model_providers.__base.tokenizers.gpt2_tokenzier import GPT2Tokenizer from core.model_runtime.model_providers.__base.tokenizers.gpt2_tokenzier import GPT2Tokenizer
from core.splitter.text_splitter import ( from core.splitter.text_splitter import (
TS, TS,
AbstractSet,
Collection, Collection,
Literal, Literal,
RecursiveCharacterTextSplitter, RecursiveCharacterTextSplitter,
Set,
TokenTextSplitter, TokenTextSplitter,
Type,
Union, Union,
) )




@classmethod @classmethod
def from_encoder( def from_encoder(
cls: Type[TS],
cls: type[TS],
embedding_model_instance: Optional[ModelInstance], embedding_model_instance: Optional[ModelInstance],
allowed_special: Union[Literal[all], AbstractSet[str]] = set(),
allowed_special: Union[Literal[all], Set[str]] = set(),
disallowed_special: Union[Literal[all], Collection[str]] = "all", disallowed_special: Union[Literal[all], Collection[str]] = "all",
**kwargs: Any, **kwargs: Any,
): ):

Loading…
取消
儲存