소스 검색

feat: implement NotImplementedError for token counting in LLMs and reintroduce disabled token count method

Signed-off-by: -LAN- <laipz8200@outlook.com>
tags/0.15.6-alpha.1^0
-LAN- 7 달 전
부모
커밋
fa6fa730b5
No account linked to committer's email address
1개의 변경된 파일5개의 추가작업 그리고 2개의 파일을 삭제
  1. 5
    2
      api/core/model_runtime/model_providers/__base/large_language_model.py

+ 5
- 2
api/core/model_runtime/model_providers/__base/large_language_model.py 파일 보기

@@ -553,8 +553,7 @@ if you are not sure about the structure.
:param tools: tools for tool calling
:return:
"""
# Disable the token count in LLMs for profermance testing.
return 0
raise NotImplementedError

def enforce_stop_tokens(self, text: str, stop: list[str]) -> str:
"""Cut off the text as soon as any stop words occur."""
@@ -915,3 +914,7 @@ if you are not sure about the structure.
filtered_model_parameters[parameter_name] = parameter_value

return filtered_model_parameters

def _get_num_tokens_by_gpt2(self, text: str) -> int:
# Disable the token count in LLMs for profermance testing.
return 0

Loading…
취소
저장