ReplyLa Logo
Chatbot

AI Feedback

Flag uncertain answers, review them, and save verified information to AI Knowledge.

AI Feedback collects answers that may need human review. You can verify the answer, provide a correction, and save the approved information to AI Knowledge.

Enable Feedback Alerts

  1. Open a chatbot and go to AI Feedback.
  2. Turn on Alert Me on Unsure Answers.
  3. Choose a Confidence Sensitivity level.
  4. Optionally enable Hand off to a human when unsure.
  5. Save the page.

Automatic handoff uses the chatbot's Human Takeover configuration and requires Human Takeover to be enabled.

Confidence Sensitivity

LevelBehaviour
MinimalAlmost never flags an answer.
RelaxedFlags only clearly uncertain answers.
BalancedRecommended starting point for most chatbots.
SensitiveFlags most uncertain answers.
Very SensitiveFlags almost everything that may need review.

A higher sensitivity creates more review items. Start with Balanced, then adjust it based on the quality and volume of the flagged questions.

Questions to Review

The table shows the customer query, flag reason, date, and current status. Reasons can include:

  • Low confidence.
  • Possible hallucination.
  • No matching knowledge.
  • A manual flag.

Click Review to open the question and AI response.

Verify an Answer

If the Answer Is Correct

  1. Click Yes, it's correct.
  2. Select an existing knowledge base or create a new one.
  3. Click Save & Done.

If the Answer Is Wrong

  1. Click No, it's wrong.
  2. Enter the correct answer.
  3. Select an existing knowledge base or create a new one.
  4. Click Save & Done.

Choose Skip this question when the item does not need action. Skipped items are dismissed.

Saving a verified answer creates knowledge that can help with similar questions in future conversations. It does not rewrite earlier messages that were already sent.

  • Review the queue regularly after launch or after major training changes.
  • Correct high-impact topics such as price, delivery, refunds, and availability first.
  • Combine repeated answers into a clear, reusable knowledge document.
  • Test the updated answer in AI Playground.
Copyright © 2026