Bläddra i källkod

fix: llm_usage.total_tokens stat (#19177)

tags/1.4.0
Will 5 månader sedan
förälder
incheckning
0358859467
Inget konto är kopplat till bidragsgivarens mejladress
2 ändrade filer med 2 tillägg och 0 borttagningar
  1. 1
    0
      api/core/agent/cot_agent_runner.py
  2. 1
    0
      api/core/agent/fc_agent_runner.py

+ 1
- 0
api/core/agent/cot_agent_runner.py Visa fil

@@ -80,6 +80,7 @@ class CotAgentRunner(BaseAgentRunner, ABC):
llm_usage = final_llm_usage_dict["usage"]
llm_usage.prompt_tokens += usage.prompt_tokens
llm_usage.completion_tokens += usage.completion_tokens
llm_usage.total_tokens += usage.total_tokens
llm_usage.prompt_price += usage.prompt_price
llm_usage.completion_price += usage.completion_price
llm_usage.total_price += usage.total_price

+ 1
- 0
api/core/agent/fc_agent_runner.py Visa fil

@@ -65,6 +65,7 @@ class FunctionCallAgentRunner(BaseAgentRunner):
llm_usage = final_llm_usage_dict["usage"]
llm_usage.prompt_tokens += usage.prompt_tokens
llm_usage.completion_tokens += usage.completion_tokens
llm_usage.total_tokens += usage.total_tokens
llm_usage.prompt_price += usage.prompt_price
llm_usage.completion_price += usage.completion_price
llm_usage.total_price += usage.total_price

Laddar…
Avbryt
Spara