浏览代码

Rafe: Update LLMService type hints (#9131)

### What problem does this PR solve?

- Add Generator return type annotation for tts method
- Import typing.Generator for type hints

### Type of change

- [x] Refactoring
tags/v0.20.0
Liu An 3 个月前
父节点
当前提交
e9c5c7bc7c
没有帐户链接到提交者的电子邮件
共有 1 个文件被更改,包括 2 次插入2 次删除
  1. 2
    2
      api/db/services/llm_service.py

+ 2
- 2
api/db/services/llm_service.py 查看文件

import logging import logging
import re import re
from functools import partial from functools import partial
from typing import Generator


from langfuse import Langfuse from langfuse import Langfuse


mdlnm += "___OpenAI-API" mdlnm += "___OpenAI-API"
elif fid == "VLLM": elif fid == "VLLM":
mdlnm += "___VLLM" mdlnm += "___VLLM"
objs = cls.query(tenant_id=tenant_id, llm_name=mdlnm, llm_factory=fid) objs = cls.query(tenant_id=tenant_id, llm_name=mdlnm, llm_factory=fid)
if not objs: if not objs:
return return


return txt return txt


def tts(self, text: str) -> None:
def tts(self, text: str) -> Generator[bytes, None, None]:
if self.langfuse: if self.langfuse:
span = self.trace.span(name="tts", input={"text": text}) span = self.trace.span(name="tts", input={"text": text})



正在加载...
取消
保存