瀏覽代碼

index add to db when dataset updated (#588)

tags/0.3.10
Jyong 2 年之前
父節點
當前提交
9f28a48a92
沒有連結到貢獻者的電子郵件帳戶。
共有 1 個檔案被更改,包括 3 行新增4 行删除
  1. 3
    4
      api/tasks/deal_dataset_vector_index_task.py

+ 3
- 4
api/tasks/deal_dataset_vector_index_task.py 查看文件

@@ -44,14 +44,13 @@ def deal_dataset_vector_index_task(dataset_id: str, action: str):
if dataset_documents:
# save vector index
index = IndexBuilder.get_index(dataset, 'high_quality', ignore_high_quality_check=True)
documents = []
for dataset_document in dataset_documents:
# delete from vector index
segments = db.session.query(DocumentSegment).filter(
DocumentSegment.document_id == dataset_document.id,
DocumentSegment.enabled == True
) .order_by(DocumentSegment.position.asc()).all()

documents = []
for segment in segments:
document = Document(
page_content=segment.content,
@@ -65,8 +64,8 @@ def deal_dataset_vector_index_task(dataset_id: str, action: str):

documents.append(document)

# save vector index
index.add_texts(documents)
# save vector index
index.add_texts(documents)

end_at = time.perf_counter()
logging.info(

Loading…
取消
儲存