瀏覽代碼

Fix: RateLimit requests were not released when a streaming generation exception occurred (#11540)

tags/0.14.0
liuzhenghua 10 月之前
父節點
當前提交
d05f189049
沒有連結到貢獻者的電子郵件帳戶。
共有 2 個檔案被更改,包括 4 行新增1 行删除
  1. 1
    1
      api/core/app/features/rate_limiting/rate_limit.py
  2. 3
    0
      api/services/app_generate_service.py

+ 1
- 1
api/core/app/features/rate_limiting/rate_limit.py 查看文件

raise StopIteration raise StopIteration
try: try:
return next(self.generator) return next(self.generator)
except StopIteration:
except Exception:
self.close() self.close()
raise raise



+ 3
- 0
api/services/app_generate_service.py 查看文件

raise ValueError(f"Invalid app mode {app_model.mode}") raise ValueError(f"Invalid app mode {app_model.mode}")
except RateLimitError as e: except RateLimitError as e:
raise InvokeRateLimitError(str(e)) raise InvokeRateLimitError(str(e))
except Exception:
rate_limit.exit(request_id)
raise
finally: finally:
if not streaming: if not streaming:
rate_limit.exit(request_id) rate_limit.exit(request_id)

Loading…
取消
儲存