You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

autokeyword_autoquestion.mdx 4.3KB

12345678910111213141516171819202122232425262728293031323334353637383940414243444546474849505152535455565758596061626364656667
  1. ---
  2. sidebar_position: 3
  3. slug: /autokeyword_autoquestion
  4. ---
  5. # Auto-keyword Auto-question
  6. import APITable from '@site/src/components/APITable';
  7. Use a chat model to generate keywords and questions from the original chunks.
  8. ---
  9. When selecting a chunking method, you can also enable auto-keyword or auto-question generation to increase retrieval rates. This feature uses a chat model to produce a specified number of keywords and questions from each created chunk, creating a layer of higher-level information from the original content.
  10. :::tip NOTE
  11. Enabling this feature increases document indexing time, as all created chunks will be sent to the chat model for keyword or question generation.
  12. :::
  13. - **Auto-keyword**
  14. - **Definition:** The number of additional keywords the LLM generates for each chunk. By supplying synonyms for text that is unfriendly to tokenization or multilingual content, this improves recall for full-text or hybrid retrieval. It can also be used to correct bad cases. Disabling this can significantly accelerate parsing.
  15. - **Common Values:**
  16. - `0`: Disabled;
  17. - `3`-`5` = Recommended (if a chunk has over a thousand characters, more keywords may be needed);
  18. - Maximum `30`. Note that, as the number increases, the marginal benefit decreases.
  19. - **Auto-question**
  20. - **Definition:** Generates potential FAQ-style questions for each chunk, making retrieval matches more aligned with real user queries (Who/What/Why).
  21. - **Common Values:**
  22. - `0` = disabled;
  23. - `1–2` = commonly used (if a chunk has thousands of characters, more may be needed);
  24. - Upper limit `30` (to avoid generating too many at once). Can also be used to correct bad cases.
  25. - **Typical Use Cases:** Scenarios requiring FAQ retrieval, such as product manuals, policy documents, etc.
  26. ## Configuration
  27. On the **Configuration** page of your knowledge base, you will find the Auto-keyword and Auto-question sliders under **Page rank**.
  28. :::tip NOTE
  29. The Auto-keyword or Auto-question value must be an integer. If you set their value to a non-integer, say 1.7, it will be rounded down to the nearest integer, which in this case is 1.
  30. :::
  31. ## Best practices
  32. If you are uncertain how to set auto-keyword or auto-question values, here are some best practices gathered from our community:
  33. ```mdx-code-block
  34. <APITable>
  35. ```
  36. | Use cases or typical scenarios | Document volume/length | Auto_keyword (0–30) | Auto_question (0–30) |
  37. |---------------------------------------------------------------------|---------------------------------|----------------------------|----------------------------|
  38. | 1. Internal Process Guidance for Employee Handbook | Small, under 10 pages | 0 | 0 |
  39. | 2. Customer Service FAQ Hot Questions | Medium, 10–100 pages | 3–7 | 1–3 |
  40. | 3. Technical Whitepapers: Development Standards, Protocol Explanations | Large, over 100 pages | 2–4 | 1–2 |
  41. | 4. Contracts / Regulations / Legal Clause Retrieval | Large, over 50 pages | 2–5 | 0–1 |
  42. | 5. Multi-repository Layered New Documents + Old Archive | Many | Adjust as appropriate |Adjust as appropriate |
  43. | 6. Social Media Comment Pool: Multilingual & Mixed Spelling | Very large volume of short text | 8–12 | 0 |
  44. | 7. Operational Logs for DevOps Troubleshooting | Very large volume of short text | 3–6 | 0 |
  45. | 8. Marketing Asset Library: Multilingual Product Descriptions | Medium | 6–10 | 1–2 |
  46. | 9. Training Courseware / eBooks | Large | 2–5 | 1–2 |
  47. | 10. Maintenance Manual: Equipment Diagrams + Steps | Medium | 3–7 | 1–2 |
  48. ```mdx-code-block
  49. </APITable>
  50. ```