소스 검색

fix: wrong token usage in iteration node for streaming result (#5336)

tags/0.6.12
rerorero 1 년 전
부모
커밋
9b7fdadce4
No account linked to committer's email address
2개의 변경된 파일10개의 추가작업 그리고 3개의 파일을 삭제
  1. 3
    2
      api/core/app/entities/task_entities.py
  2. 7
    1
      api/core/app/task_pipeline/workflow_iteration_cycle_manage.py

+ 3
- 2
api/core/app/entities/task_entities.py 파일 보기

@@ -367,7 +367,7 @@ class IterationNodeNextStreamResponse(StreamResponse):

class IterationNodeCompletedStreamResponse(StreamResponse):
"""
NodeStartStreamResponse entity
NodeCompletedStreamResponse entity
"""
class Data(BaseModel):
"""
@@ -385,6 +385,7 @@ class IterationNodeCompletedStreamResponse(StreamResponse):
error: Optional[str] = None
elapsed_time: float
total_tokens: int
execution_metadata: Optional[dict] = None
finished_at: int
steps: int

@@ -545,4 +546,4 @@ class WorkflowIterationState(BaseModel):
total_tokens: int = 0
node_data: BaseNodeData

current_iterations: dict[str, Data] = None
current_iterations: dict[str, Data] = None

+ 7
- 1
api/core/app/task_pipeline/workflow_iteration_cycle_manage.py 파일 보기

@@ -95,6 +95,9 @@ class WorkflowIterationCycleManage(WorkflowCycleStateManager):
error=None,
elapsed_time=time.perf_counter() - current_iteration.started_at,
total_tokens=current_iteration.total_tokens,
execution_metadata={
'total_tokens': current_iteration.total_tokens,
},
finished_at=int(time.time()),
steps=current_iteration.current_index
)
@@ -276,7 +279,10 @@ class WorkflowIterationCycleManage(WorkflowCycleStateManager):
error=error,
elapsed_time=time.perf_counter() - current_iteration.started_at,
total_tokens=current_iteration.total_tokens,
execution_metadata={
'total_tokens': current_iteration.total_tokens,
},
finished_at=int(time.time()),
steps=current_iteration.current_index
)
)
)

Loading…
취소
저장