DealerAI
Portal GuideKnowledge Base

How to test that the AI uses your latest knowledge

Verify the AI's answers reflect the most recent Knowledge Base updates before customers see them.

After retraining the AI, confirm the new content is being used correctly by asking the AI yourself.

Test in Preview

Preview puts your real webchat widget inside the portal, running against your current configuration, so it's the quickest way to ask.

The Preview page

Pick the dealership in the switcher at the top, then open Preview.
Ask a question that should use the new entry.
Read the reply and confirm it reflects what you wrote.
Try a few rephrasings of the same question to check the AI matches the entry consistently.

Preview conversations are real conversations. They appear in Chats and count towards your reporting, and the AI can create a contact or book an appointment from one. Use obviously fake details, and don't take a test all the way through a booking unless you intend to clean it up.

What to look for

CheckWhy
The answer mentions the new factConfirms the entry is reachable.
The answer is accurateConfirms the entry was understood, not paraphrased incorrectly.
The answer is brief and conversationalLong answers often mean the source entry is too verbose — trim it.
The AI doesn't contradict itself in follow-up turnsIndicates a clean entry without conflicting older content.

Example test prompts

If you added a fact about loaner cars:

  • "Do you offer loaner vehicles?"
  • "Can I get a courtesy car while my car is being serviced?"
  • "What's the loaner policy?"

The AI should respond consistently across all three phrasings.

Always test with at least three different phrasings of the same question. Customers rarely ask the way you'd expect.

When the AI gives a wrong or stale answer

  1. Confirm you trained. Re-open Knowledge Base and check the line under the title reads the full count trained — 4 knowledge bases, 4/4 trained. If it doesn't, save and train again.
  2. Check for conflicting entries. Look through the Table of Contents for older entries that contradict the new one, and update or delete them.
  3. Tighten the entry. Make the wording more direct and specific — the AI matches concrete statements better than vague ones.
  4. Save and retrain, then reload Preview and re-test.

Test on the channel customers use

Preview loads the widget expanded, with no launcher and none of the pop-up invitations, so it can't show you everything a visitor sees. Once Preview looks good, test the channels you actually serve:

  • Send a test SMS from your own phone to the dealership number.
  • Email the dealership address from a personal email.
  • Open the live webchat widget on your own website.

This catches channel-specific quirks Preview can't reproduce.

On this page