Quellcode durchsuchen

fix: llm_usage.total_tokens stat (#19177)

tags/1.4.0
Will vor 5 Monaten
Ursprung
Commit
0358859467
Es ist kein Account mit der E-Mail-Adresse des Committers verbunden
2 geänderte Dateien mit 2 neuen und 0 gelöschten Zeilen
  1. 1
    0
      api/core/agent/cot_agent_runner.py
  2. 1
    0
      api/core/agent/fc_agent_runner.py

+ 1
- 0
api/core/agent/cot_agent_runner.py Datei anzeigen

@@ -80,6 +80,7 @@ class CotAgentRunner(BaseAgentRunner, ABC):
llm_usage = final_llm_usage_dict["usage"]
llm_usage.prompt_tokens += usage.prompt_tokens
llm_usage.completion_tokens += usage.completion_tokens
llm_usage.total_tokens += usage.total_tokens
llm_usage.prompt_price += usage.prompt_price
llm_usage.completion_price += usage.completion_price
llm_usage.total_price += usage.total_price

+ 1
- 0
api/core/agent/fc_agent_runner.py Datei anzeigen

@@ -65,6 +65,7 @@ class FunctionCallAgentRunner(BaseAgentRunner):
llm_usage = final_llm_usage_dict["usage"]
llm_usage.prompt_tokens += usage.prompt_tokens
llm_usage.completion_tokens += usage.completion_tokens
llm_usage.total_tokens += usage.total_tokens
llm_usage.prompt_price += usage.prompt_price
llm_usage.completion_price += usage.completion_price
llm_usage.total_price += usage.total_price

Laden…
Abbrechen
Speichern