Skip to content
Knowledge and answers

Fix a wrong answer

Almost every bad answer has one of three causes, and they are fixed in different places. Either the agent did not have the fact (knowledge), or it was told something untrue (instructions), or the conversation should have gone to a person and could not (handoff). Work out which before you change anything — rewriting a persona that was never the problem is the most common wasted afternoon in this product.

Updated 2026-10-23 · 5 min read · More in knowledge and answers

Start from the sentence, not the settings

Open the conversation and find the exact sentence that was wrong. Not the general shape of the failure — the sentence. What the agent said tells you where it came from, and reading it next to the question is usually enough to sort it.

Then ask the same question yourself: Preview, at the top of every page inside the agent, opens a chat with it beside the page you are on. If the answer is wrong there too, you have something reproducible to fix. If it is right, the difference is usually context earlier in the customer's conversation, which is its own useful finding.

Cause one: it did not have the fact

The agent said it did not know, or gave a vague answer that dodged the question. Search your knowledge for the fact. If it genuinely is not there, the agent was right to say so — 'our refund window is not listed in what I have here' is an honest answer to a website that does not state it, and it is a content problem, not a model problem.

The fix is a note: state the fact plainly, in one or two sentences, and re-ask. This is the most common cause by a distance, and the cheapest to fix.

Cause two: it was told something untrue

The agent stated something specific and confident — a price, an address, a policy — that is simply wrong. Look in the instructions under Instructions before you look anywhere else. A fact that was hand-typed into the instructions gets asserted with complete confidence and never gets corrected by a re-crawl.

Delete it from the instructions. If it is true, put it in knowledge instead, where it has a source and can be updated. Instructions should read like rules for behaviour, not like a fact sheet.

Cause three: nobody could take it

The customer asked for a person, or asked something no agent should answer, and the conversation went nowhere. Both are under Handoff on the agent. In chat and email, check that A person in chat & email is switched on. On the phone, check that Transfer calls to a person has a number at all, and that its switch is on. Without both there is no transfer tool, so a caller saying 'representative' is only ever offered a message.

This is worth checking on every agent you run, not just the one that failed. It is a single empty field and it is invisible until a real customer hits it.

  1. A person in chat & email

    Is it on under Handoff? On a new agent it is off.

  2. Transfer calls to a person

    Is there a number under Handoff, is its switch on, and is it a line somebody answers?

  3. Business hours

    If A person in chat & email is limited to them, was the chat or email outside them? They never affect phone transfers.

Then re-ask

Every fix ends with the same question asked again in Preview. A change you did not verify is a change you are guessing about, and knowledge in particular can surprise you — a note that reads perfectly can still lose to a page that mentions the same words more often.

If the answer is still wrong after a note that plainly states the fact, that is a retrieval problem rather than a content one, and it is worth telling us: it is the kind of thing we fix in the product rather than in your configuration.

Once it is right, keep it right with a test. Under Tests on the agent, describe the customer who asked and write what the answer has to contain as the success criterion. A simulated customer asks it as often as you like and a judge grades every answer, so the next change to your instructions or knowledge shows its pass rate before a customer finds the old mistake again.

FAQ

Related questions

Almost certainly the instructions. A price that appears nowhere on your website and nowhere in your knowledge came from a hand-typed line under Instructions. Delete it there, and if the price is real, add it as knowledge.

Still stuck? A person will answer.