RAG ChatsRAG Chats

Test Your Bot

Before deploying, test your bot thoroughly to ensure it provides accurate, helpful responses.

Using the Chat Interface

Every bot has a built-in chat interface for testing. Access it from your bot's Chat tab in the dashboard.

What to Test

  • Basic questions: Start with simple questions that your documents should answer easily.
  • Specific details: Ask about specific facts, numbers, or procedures mentioned in your content.
  • Edge cases: Test questions that might be ambiguous or span multiple topics.
  • Out-of-scope questions: See how the bot handles questions not covered by your documents.

Understanding Responses

Each response includes several pieces of information:

Answer

The generated response based on your documents and the AI model's capabilities.

Source Citations

References to the specific documents and sections used to generate the answer. Click on a source to see the exact text that was used.

Verify Sources

Always check the source citations when testing. If the bot cites irrelevant sources, you may need to adjust your similarity threshold or improve your document structure.

Confidence Score

Each retrieved chunk has a relevance score from 0 to 1. Higher scores indicate better matches. If enabled, these appear alongside citations.

Debugging Poor Responses

If your bot isn't answering well, here are common issues and fixes:

Problem: Irrelevant or Wrong Answers

  • Check sources: The bot may be retrieving wrong documents. Review the citations.
  • Increase top_k: Retrieve more chunks for better context coverage.
  • Lower similarity threshold: Allow more documents to be considered.
  • Enable reranking: Use Cohere reranking to improve relevance.

Problem: "I don't know" or Refusals

  • Check your content: The information might not be in your documents.
  • Lower similarity threshold: The bot might be too strict about what it considers relevant.
  • Enable general knowledge: Allow the bot to answer using its training data when context isn't found.

Problem: Responses Too Long/Short

  • Adjust max_tokens: Increase for longer answers, decrease for shorter.
  • Update system prompt: Add instructions about response length.

Problem: Wrong Tone or Format

  • Update system prompt: Specify the desired tone, style, and format.
  • Adjust temperature: Lower for more consistent responses, higher for variety.

Testing Checklist

  • Bot answers basic questions about your content
  • Source citations are accurate and relevant
  • Response tone matches your brand
  • Out-of-scope questions are handled gracefully
  • Response times are acceptable (<3 seconds)
  • Follow-up questions work correctly

Advanced: API Testing

You can also test your bot using the API. This is useful for automated testing or testing from your own application.

curl -X POST https://api.ragchats.ai/v1/bots/YOUR_BOT_ID/query \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"message": "What is your return policy?"}'

Next Steps

Once you're happy with your bot's responses, it's time to deploy it to your website or application.

Deploy Your Bot →