ソースを参照

update clean embedding cache logic (#6434)

tags/0.6.15
Jyong 1年前
コミット
e493ce9981
コミッターのメールアドレスに関連付けられたアカウントが存在しません
1個のファイルの変更1行の追加3行の削除
  1. 1
    3
      api/schedule/clean_embedding_cache_task.py

+ 1
- 3
api/schedule/clean_embedding_cache_task.py ファイルの表示

clean_days = int(dify_config.CLEAN_DAY_SETTING) clean_days = int(dify_config.CLEAN_DAY_SETTING)
start_at = time.perf_counter() start_at = time.perf_counter()
thirty_days_ago = datetime.datetime.now() - datetime.timedelta(days=clean_days) thirty_days_ago = datetime.datetime.now() - datetime.timedelta(days=clean_days)
page = 1
while True: while True:
try: try:
embeddings = db.session.query(Embedding).filter(Embedding.created_at < thirty_days_ago) \ embeddings = db.session.query(Embedding).filter(Embedding.created_at < thirty_days_ago) \
.order_by(Embedding.created_at.desc()).paginate(page=page, per_page=100)
.order_by(Embedding.created_at.desc()).limit(100).all()
except NotFound: except NotFound:
break break
for embedding in embeddings: for embedding in embeddings:
db.session.delete(embedding) db.session.delete(embedding)
db.session.commit() db.session.commit()
page += 1
end_at = time.perf_counter() end_at = time.perf_counter()
click.echo(click.style('Cleaned embedding cache from db success latency: {}'.format(end_at - start_at), fg='green')) click.echo(click.style('Cleaned embedding cache from db success latency: {}'.format(end_at - start_at), fg='green'))

読み込み中…
キャンセル
保存