### What problem does this PR solve? Log llm response on exception ### Type of change - [x] Refactoring