Most chatbot dashboards are built around what the bot did well. The most useful screen in ConvoRail is the opposite: the list of questions it could not answer. Every item on that list is a real person who typed a real question into your website and did not get a confirmed answer. This guide shows how to turn that list into a weekly habit that makes the bot, and often the website itself, better.
Why a Gap List Beats a Success Count
A bot that answered 200 questions tells you very little. You cannot act on it. A list of 12 questions it could not answer tells you exactly what to write next. It also shows something a normal website cannot: what your visitors wanted to know that your pages did not tell them.
Because ConvoRail only answers from the knowledge you have given it, a gap is not hidden. It becomes a visible, specific to-do item instead of a silent wrong answer. That is the trade you make with a grounded bot: it says "I don't know" out loud, and in return you get a map of what is missing.
Step 1: Open the Unanswered List Once a Week
Pick a fixed time, such as Monday morning, and spend ten minutes on it. More often than that and there is not enough new data; less often and the list becomes long and discouraging. Sort out what you see into four buckets:
- 1Real questions you can answer now. Write a Q&A pair and you are done.
- 2The same question phrased differently. Add one pair, and consider adding a second wording if the questions are very different.
- 3Questions that need a person. For example, "Can you do this for my specific order?" These should stay with your team in the inbox.
- 4Noise. Greetings, tests and unrelated messages. Ignore them.
Step 2: Write the Answer Properly
An answer written in a hurry becomes the next problem. When you add the pair, follow these rules:
- Use the visitor's wording in the question. If people type "how long does delivery take", do not title it "Shipping lead time policy".
- Put the answer first. Start with the fact, then add the detail.
- Include limits and exceptions. "Delivery takes 3 to 5 working days, except for remote areas" is better than "Delivery takes 3 to 5 days".
- Link to the right page if there is one. The bot's answers can include links, bold text and bullet lists, which makes them easier to read.
If you need more detail on writing good pairs, see how to write Q&A pairs that make a chatbot actually useful.
Step 3: Use the Category Field
As your knowledge base grows, finding one pair among a few hundred becomes difficult. Give every pair a category, such as Pricing, Delivery, Returns or Booking. You can set the category when you add a pair or by uploading a CSV with a category column, and you can search and filter the list later. A tidy knowledge base is faster to maintain, and maintenance is what keeps a bot accurate.
Step 4: Check the Reverse Signal
The unanswered list shows what is missing. Two other places show how the bot is doing on what it does answer:
- Conversation ratings. Visitors can rate a conversation when it ends, and the rating shows in your inbox. A low rating on a conversation the bot handled is a strong hint that an answer is unclear or out of date.
- The usage dashboard. It shows the Q&A pairs you are using and the messages handled this month against your plan's limits, so you can see when you are approaching a limit before it becomes a problem.
Step 5: Fix the Website Too
The most overlooked benefit is outside the chatbot. If visitors keep asking something your pages already answer, the page is hard to find or hard to understand. Use the list as a content brief:
| What you see | What it usually means | What to do |
|---|---|---|
| The same question appears many times | Visitors cannot find the answer on the site | Add a Q&A pair and make the page clearer or easier to reach |
| Questions about prices or fees | Pricing is unclear or hidden | Add a pair now and review how pricing is shown |
| Questions about a process, such as returns | The process is not explained plainly | Write the pair, then simplify the policy page |
| Questions you cannot answer at all | A decision has not been made yet | Decide, then write the answer |
Pro Tip: Keep a running note of questions you decided not to answer, and why. It stops the same debate coming up every month and keeps your knowledge base consistent with your policies.
A Weekly Routine That Takes Fifteen Minutes
A fifteen-minute weekly routine is enough: sort the unanswered list, write the missing pairs, check low ratings, check usage and note one page to improve.
- 1Open the unanswered list and sort it into the four buckets.
- 2Write pairs for the first bucket and tag them with a category.
- 3Look at any low ratings in the inbox and fix the answer behind them.
- 4Check usage against your plan.
- 5Note one page on your website to improve.
After a month, the list gets shorter and the questions get more unusual. That is the sign that your knowledge base is covering what people actually ask.
What Good Looks Like After a Month
After a month of weekly reviews, the unanswered list should be shorter and its questions more unusual. If it is longer, either traffic grew or your answers are not matching how visitors phrase things.
- The same questions stop appearing. Once you add a pair, repeats should disappear. If they do not, reword the question the way visitors type it.
- New questions are specific. Early lists are full of basics; later lists contain edge cases, which means the basics are covered.
- Fewer handoffs on routine topics. Your inbox should contain more complex conversations and fewer "what are your hours" messages.
Mistakes That Make the List Useless
The unanswered list becomes useless when nobody reads it, when every entry is answered with a long essay, or when pairs are added without checking they conflict with existing ones.
- Reviewing only when there is a problem. Gaps pile up and the list becomes discouraging.
- Answering with too much. A visitor wants the fact first. Put the detail after it.
- Adding duplicates. Search the knowledge base before writing a new pair, so you update the existing answer instead.
- Ignoring the questions that need a person. These are not failures; leave them in the inbox and make sure someone owns them.
Related reading: a monthly knowledge base routine, reducing repetitive customer questions and turning chatbot questions into blog posts and FAQ pages.
Conclusion
The unanswered-question list is the most valuable feature on a grounded chatbot, because it turns the bot's honesty into a to-do list. Review it weekly, write clear answers with the visitor's wording, use categories, watch ratings and usage, and treat repeated questions as feedback on your website. The bot gets better and so does the site.
Key takeaways
- A grounded bot makes gaps visible: every unanswered question is a specific thing to write next.
- Review the list weekly and sort it into answerable, rephrased, needs-a-person and noise.
- Write answers in the visitor's wording, answer first, with limits and exceptions.
- Use categories, ratings and the usage dashboard to keep the knowledge base tidy and accurate.
- Repeated questions are also feedback on how clear your website is.
Quick Summary
Improving your chatbot with unanswered questions means reviewing the list of questions ConvoRail could not answer once a week, writing clear Q&A pairs for the real ones and leaving person-level questions to your team. Add categories to keep the knowledge base tidy, read conversation ratings for unclear answers and watch usage against your plan. Repeated questions also show which website pages need to be clearer.
Want to see grounded answers on your own site?
Start free, add your Q&A pairs and paste one script tag. No credit card required.

Founder & CEO
Writes about grounded AI chatbots for websites: how they work, how to measure them and what to check before you buy.
Topics
Get new posts by email
Guides on AI chatbots for websites, straight to your inbox.
