Explorar el Código

when qwen rerank model not return ok, raise exception to notice user (#3593)

### What problem does this PR solve?

When calling the Qwen rerank model, if the model does not return
correctly, an exception should be raised to notify the user, rather than
simply returning a value of 0, as this would be confusing to the user.
### Type of change          

- [x] New Feature (non-breaking change which adds functionality)
tags/v0.14.0
liwenju0 hace 11 meses
padre
commit
875096384b
No account linked to committer's email address
Se han modificado 1 ficheros con 2 adiciones y 1 borrados
  1. 2
    1
      rag/llm/rerank_model.py

+ 2
- 1
rag/llm/rerank_model.py Ver fichero

@@ -452,4 +452,5 @@ class QWenRerank(Base):
for r in resp.output.results:
rank[r.index] = r.relevance_score
return rank, resp.usage.total_tokens
return rank, 0
else:
raise ValueError(f"Error calling QWenRerank model {self.model_name}: {resp.status_code} - {resp.text}")

Cargando…
Cancelar
Guardar