Bladeren bron

Fix: rerank with vllm issue. (#6306)

### What problem does this PR solve?

#6301

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
tags/v0.18.0
Kevin Hu 7 maanden geleden
bovenliggende
commit
5b04b7d972
No account linked to committer's email address
1 gewijzigde bestanden met toevoegingen van 1 en 1 verwijderingen
  1. 1
    1
      rag/llm/rerank_model.py

+ 1
- 1
rag/llm/rerank_model.py Bestand weergeven

@@ -382,7 +382,7 @@ class CoHereRerank(Base):
from cohere import Client

self.client = Client(api_key=key, base_url=base_url)
self.model_name = model_name
self.model_name = model_name.split("___")[0]

def similarity(self, query: str, texts: list):
token_count = num_tokens_from_string(query) + sum(

Laden…
Annuleren
Opslaan