소스 검색

fix: llm_usage.total_tokens stat (#19177)

tags/1.4.0
Will 5 달 전
부모
커밋
0358859467
No account linked to committer's email address
2개의 변경된 파일2개의 추가작업 그리고 0개의 파일을 삭제
  1. 1
    0
      api/core/agent/cot_agent_runner.py
  2. 1
    0
      api/core/agent/fc_agent_runner.py

+ 1
- 0
api/core/agent/cot_agent_runner.py 파일 보기

@@ -80,6 +80,7 @@ class CotAgentRunner(BaseAgentRunner, ABC):
llm_usage = final_llm_usage_dict["usage"]
llm_usage.prompt_tokens += usage.prompt_tokens
llm_usage.completion_tokens += usage.completion_tokens
llm_usage.total_tokens += usage.total_tokens
llm_usage.prompt_price += usage.prompt_price
llm_usage.completion_price += usage.completion_price
llm_usage.total_price += usage.total_price

+ 1
- 0
api/core/agent/fc_agent_runner.py 파일 보기

@@ -65,6 +65,7 @@ class FunctionCallAgentRunner(BaseAgentRunner):
llm_usage = final_llm_usage_dict["usage"]
llm_usage.prompt_tokens += usage.prompt_tokens
llm_usage.completion_tokens += usage.completion_tokens
llm_usage.total_tokens += usage.total_tokens
llm_usage.prompt_price += usage.prompt_price
llm_usage.completion_price += usage.completion_price
llm_usage.total_price += usage.total_price

Loading…
취소
저장