Kaynağa Gözat

boost paralal of graphrag (#1924)

### What problem does this PR solve?


### Type of change

- [x] Performance Improvement
tags/v0.10.0
Kevin Hu 1 yıl önce
ebeveyn
işleme
da2d8b8267
No account linked to committer's email address
1 değiştirilmiş dosya ile 2 ekleme ve 2 silme
  1. 2
    2
      graphrag/index.py

+ 2
- 2
graphrag/index.py Dosyayı Görüntüle



assert left_token_count > 0, f"The LLM context length({llm_bdl.max_length}) is smaller than prompt({ext.prompt_token_count})" assert left_token_count > 0, f"The LLM context length({llm_bdl.max_length}) is smaller than prompt({ext.prompt_token_count})"


BATCH_SIZE=1
BATCH_SIZE=4
texts, graphs = [], [] texts, graphs = [], []
cnt = 0 cnt = 0
threads = [] threads = []
exe = ThreadPoolExecutor(max_workers=12)
exe = ThreadPoolExecutor(max_workers=50)
for i in range(len(chunks)): for i in range(len(chunks)):
tkn_cnt = num_tokens_from_string(chunks[i]) tkn_cnt = num_tokens_from_string(chunks[i])
if cnt+tkn_cnt >= left_token_count and texts: if cnt+tkn_cnt >= left_token_count and texts:

Loading…
İptal
Kaydet