momo is in early access: help shape the open-source AI support desk. Get started
momo

Create a Chatbot for Customer Support: Step-by-Step Guide

Create a chatbot for customer support by starting with a small set of common questions, connecting answers to approved support information, and deciding in advance when a person must take over. This guide walks you through the setup, testing, and review so you can launch a focused pilot with a prepared knowledge source, a tested escalation path, and a plan for reviewing results. Before launch, test both the answers and the handoff as a customer would experience them. At the end, you should have a defined pilot scope, a prepared knowledge source, a tested escalation path, and a plan for reviewing results.

Before you start: gather the right inputs

Before building anything, collect the material and people needed to make the chatbot useful and safe. You need a clear support goal, examples of real customer questions, current approved answers, and a person responsible for reviewing the bot’s work and taking escalations.

Start by deciding what problem you want to improve. It might be shorter waits for straightforward questions, fewer repetitive replies for the team, or a more consistent explanation of a published policy. Keep the goal tied to a customer outcome. “Deflect tickets” on its own is not enough: a customer who leaves without an answer has not been helped.

Gather the policies, FAQs, product guidance, and troubleshooting instructions that currently represent the business’s approved answers. Check that the team knows which versions are current and who can resolve disagreements. If there are several competing answers about the same policy, settle that before asking a bot to use them.

You will also need a clear boundary between explaining a policy and making a decision. A bot may be able to describe a published returns period; deciding whether a particular refund should be approved is a different task. Write down those distinctions in ordinary language that a support teammate can apply.

Finally, identify who will review conversations and who will receive escalations. A bot does not remove the need for a staffed support destination. If no one owns the inbox or checks the results, even a well-built flow can leave customers waiting.

1. Choose initial support questions based on customer needs

Choose initial questions by looking at what customers actually ask and which answers are stable, easy to verify, and low risk. Start with recurring topics such as shipping, returns, product details, or pricing when your approved material gives a clear answer. Leave judgment-heavy and account-specific cases for a person.

Review recent support conversations and group them by topic. Look beyond the subject line: customers may describe the same issue in different words, or ask a simple question that turns into a sensitive case after a follow-up. This evidence helps identify which customer support questions are frequent enough and straightforward enough for a first pilot. Keep examples of the wording customers use, not just the labels your team assigns.

For each topic, consider whether the answer stays consistent across customers and whether a support teammate can check it against published information. A question about a general delivery policy may be a suitable starting point. A request to make an exception to that policy needs human judgment. A question that depends on a customer’s account or order requires access and verification the chatbot may not have.

Map where these questions occur in the customer journey. A product question may appear before purchase, while a return question may arise after delivery. This helps you decide where the chatbot belongs and which information it should make easy to find. It also helps reveal when a seemingly simple FAQ is really a sign that the customer needs a person.

Set the scope for the first release in writing. List the topics the bot may answer, the information it must rely on, and the cases it must pass on. If you cannot explain why a topic is suitable in a short sentence, keep it out of the initial scope.

2. Prepare one trustworthy source of support answers

Prepare a clear, current collection of approved material before connecting it to a chatbot. The bot can only give a dependable answer when the source itself gives your team a dependable answer. Clean up contradictory policies, outdated instructions, and unclear exceptions first.

Collect the pages and documents support staff use when answering the chosen questions. That may include FAQs, product guidance, troubleshooting instructions, and published policies. Use the version customers should follow, rather than old internal notes or an unreviewed draft. If a policy has exceptions, state them plainly and make clear who can decide whether an exception applies.

Review each item for gaps. Does it identify the relevant product or situation? Does it distinguish what happens by default from what requires review? Is a policy written in a way that a customer can understand without help from a teammate? If an answer relies on information missing from the material, either add that information with approval or instruct the bot to pass the question on.

Assign an owner to resolve conflicts. For example, if one page says one thing and another page says something else, do not expect the chatbot to guess which version is right. Ask the policy owner to approve a correction, update the customer-facing material, and verify that the corrected version is the one the chatbot can use.

A knowledge-based tool can work with material such as a website crawl, PDFs, Word files, plain text, and Q&A pairs. momo, for example, retrieves passages from a business’s own knowledge, drafts an answer, and checks it against those sources. When confident, it sends an answer with citations; when it is not confident, it says so and opens a ticket for the team. A human answer can later be saved as approved knowledge through the Teach step.

The important operational habit is to treat knowledge as something the support team owns. If a published policy changes, update the material the bot uses and then rerun the relevant tests. Do not assume that a chatbot’s answer remains correct just because it was right when first configured.

3. Pick a platform or custom build that fits your workload

Choose a platform if you need a practical route to website answers and a human inbox without owning the entire software build. Choose an API or framework approach when the required behavior needs custom application work and your team can maintain it. Compare the work you will own, not just the initial setup.

A platform can be a good fit when the main job is to answer questions from approved knowledge, show the answer to visitors, and send uncertain conversations to support. Check that the workflow matches how your team works: where messages arrive, who takes them, and what the customer sees when a human is not available. A platform’s product details and limits matter, so review them against your expected conversation volume and channels.

A custom build offers more control over how the bot connects to your application and how its behavior is implemented. That also means your team owns more of the work: preparing data, implementing the model and interfaces, handling conversation context, testing, and ongoing maintenance. An API connection alone does not provide a complete support process. You must also decide what happens to messages, how a person receives them, and how the customer is told what to expect.

Fine-tuning a model is not the first decision every support team needs to make. First establish whether your approved knowledge already contains the answers and whether a retrieval-based workflow can use that material. If you choose a custom implementation, account for the effort of preparing and maintaining information as well as the initial engineering work.

A useful selection question is: who will fix it when an answer is wrong, a policy changes, or the handoff fails? A smaller team may value a managed workflow that includes a shared inbox. A team with specific application requirements may prefer to build and maintain more of the workflow itself. For a closer look at the trade-offs, see this guide to building a custom support chatbot.

4. Set answer limits, citations, and human routing before launch

Decide what the chatbot may answer, what it must cite or rely on, and which situations require a person before opening it to customers. Make the escalation rule explicit for direct requests to speak with a human, uncertain answers, policy exceptions, and problems that remain after the published troubleshooting steps.

Write rules that distinguish neighboring cases. “Escalate refunds and returns” may be too broad if the bot should explain a published returns policy but must not approve a particular refund. State the difference plainly: it can explain what the policy says; it cannot decide whether an individual case qualifies for an exception. Test both types of question so a change does not block useful routine answers or allow a decision that belongs to a human.

Decide what information the bot should collect before handoff. Ask only for details that help the support team understand and work on the request, such as the customer’s problem and relevant context. Do not make customers repeat information they have already provided. Ensure the person receiving the conversation can see what has been said so far.

The wording presented to the customer must match what the system actually did. Do not promise a named teammate, an immediate response, a ticket number, a callback, or a completed refund unless the workflow really provides it. If a handoff did not happen, the bot should not say that the customer has been queued for a person.

Define who owns the conversation once a teammate takes over. The team should know whether the bot pauses, how a human replies, and what happens if the customer sends another message before the conversation is resolved. Do not assume automation resumes correctly after a human finishes; test any return-to-bot behavior separately.

momo includes a helpdesk inbox on every plan. Teammates can take over conversations live, and handoff collects the details the business chooses before a conversation reaches a human. This can suit a team that wants customer-facing answers and an inbox in the same support workflow, but any team should still verify that its own routing and staffing expectations are clear.

5. Test answers, sources, and complete handoffs

Test the chatbot as a customer would use it, and verify the visible answer separately from the behind-the-scenes handoff. Include routine questions, different phrasings, missing or conflicting information, sensitive requests, and direct requests for a person. Check that the source supports the answer and that a human actually receives the conversation.

Build a test set from real customer wording. For a shipping question, try the phrasing that appears in your inbox and a shorter or less specific version. For a return question, test the ordinary policy question and a case asking for an exception. Include a question whose answer is not in the material; the correct behavior may be to say the bot is unsure and route the customer to a person.

For each answer, check factual details, completeness, and whether the customer could mistake an explanation for a promise or approval. Compare any citation with the source it points to. Check that each cited source is relevant to the answer and helps the customer verify the information. Also check that the bot does not invent policy details when the material is silent.

Test the handoff in the actual customer-facing channel. Ask the bot to transfer the conversation, then check the helpdesk inbox for the conversation and the details collected. Confirm that a teammate can take ownership and that the visitor sees the real human reply. A sentence saying “I’ve passed this to support” does not prove that a transfer occurred or that a message reached the customer.

Continue testing after the transfer. Send another message as the customer while the conversation is under human ownership. Check whether the bot stays paused as intended, whether the team can reply in the same conversation, and whether any later return to automation works the way you configured it. Test outside staffed hours as well, and make sure the wording explains what happens without promising a reply that has not been arranged.

Keep a record of failed cases and the correction made. If an answer is wrong because the policy is unclear, fix the policy source. If the source is correct but the chatbot uses the wrong passage, adjust the setup and retest. If a transfer is not delivered, investigate the routing and inbox workflow rather than rewriting the customer-facing sentence to sound more confident.

For a more detailed testing checklist, see this guide to testing support chatbot accuracy. For advice on selecting a platform for this work, see AI chatbot options for customer support.

6. Launch gradually and measure outcomes, not containment alone

Start with the topics and customer journeys you tested, then review what happens in real conversations. Track whether answers are accurate, whether customers get a resolution, why cases escalate, and whether customers contact support again. A conversation ending without an agent is not proof that the issue was solved.

Before launch, define what each measure means and keep the definition stable as you review results. For example, decide what counts as resolved, how you identify a repeat contact about the same issue, and how you record an escalation. These definitions help the team compare the bot’s work with human-handled outcomes instead of relying on a single headline number.

Look at several signals together. Review a sample of conversations marked as answered to see whether the answer was accurate and complete. Record escalation reasons, unanswered questions, and any repeat contacts. Ask customers whether the answer helped when that fits your support flow, and read their feedback alongside the conversation itself.

Pay special attention to false deflection: the chatbot appears to have contained a conversation because the customer stopped replying, but the customer may have given up or sought help through another channel. Compare customer-confirmed resolutions with conversations that simply ended. If customers return with the same problem, treat that as a sign to revisit the original answer or handoff.

Review bot-resolved and human-escalated conversations separately. Human cases may involve more difficult problems, so a single combined satisfaction or response-time figure can hide what is going wrong. Look for patterns in the handoff reasons: perhaps the source is missing an answer, the boundary is unclear, or the issue correctly needs a human decision.

Make changes based on real transcripts. If the bot repeatedly gives vague answers, improve the relevant source material and rerun the test cases. If a rule escalates ordinary questions too often, clarify the distinction and retest both the cases that should transfer and the cases that should not. If a customer is told a person will reply but no handoff appears, fix ownership, routing, or staffing expectations before expanding the pilot.

Assign time for this review as part of the operating work. Policies change, new questions appear, and integrations or systems can be interrupted by technical issues. Monitoring the workflow and maintaining the knowledge are part of running a support chatbot, not optional cleanup after launch.

Troubleshooting: fix the cause of poor answers and failed transfers

When the chatbot gives vague answers, transfers too often, or promises a handoff that does not happen, trace the failure to its source. Check the approved material, the rules, and the actual inbox workflow, then repeat the customer test that exposed the problem.

Wrong or vague answers: Confirm that the relevant source is current, clear, and available to the chatbot. Look for conflicting policy wording or an exception that is not explained. If the answer depends on a decision the bot cannot make, make that boundary explicit and send the case to a person. Rerun the original question and similar questions to check the correction.

Too many transfers: Inspect the exact rule and source that triggered the escalation. A broad instruction that groups routine questions and human decisions together can block useful answers. Clarify which parts the bot may explain and which require a teammate, then test both sides of that boundary.

Not enough transfers: Review conversations where a person should have taken over, such as a direct request for human help, an unresolved troubleshooting issue, or a request for an individual policy exception. Adjust the rule that failed, and test the new rule with both clear and ambiguous customer messages.

A handoff promise without a real transfer: Check that the conversation appears in the inbox, that it is assigned or available to the intended team, and that a teammate can reply. Verify that the customer sees the reply. If the team is unavailable, make sure the bot describes the actual next step rather than implying that a person is already working on the case.

Customers repeat themselves after transfer: Review whether the human can see the conversation and the useful details collected before handoff. Improve what the bot passes to the team, or change the process so the agent can read the earlier messages before responding.

Frequently asked questions

Can I create a chatbot for customer support free?

Some chatbot builders offer free options, but check their limits and whether they include the knowledge sources, customer-facing channel, and human handoff your support workflow needs. A free option still needs clear answers, testing, and someone to handle escalations.

What support questions should a chatbot answer first?

Start with frequent, predictable questions where the answer is in approved material and does not require access to a customer account or a human decision. Shipping, published returns information, product details, and pricing can be candidates when the business has clear current answers. Keep exceptions, disputes, and requests for judgment with a person.

Should I fine-tune a model or connect it to a support knowledge base?

First check whether the approved knowledge already contains the answers and whether a tool can retrieve and use those answers reliably. This is a practical way to decide whether you need to build from scratch or can start with an existing support chatbot approach. A custom build may make sense when you need specific application behavior and can own development and maintenance. Fine-tuning, retrieval, and custom integration are different choices; decide based on the work your support use case requires, not on the assumption that a chatbot needs training from scratch.

What should happen when a chatbot cannot answer a customer?

It should say plainly that it cannot answer from the information available and provide a real route to a human. The handoff should carry the context the support team needs, and the customer should not be told that a ticket or transfer exists unless the system has actually created it.

How do I test whether a human handoff actually worked?

Check the inbox for the conversation, confirm the relevant team can take ownership, and send a human reply. Then verify what the customer sees. Test another customer message after transfer to confirm the bot behaves as intended while the team owns the conversation.

Which chatbot metrics reveal false deflection?

Review customer-confirmed resolutions, repeat contacts, answer accuracy, and conversations that ended without a clear resolution. Compare those with escalation reasons and feedback. A conversation that stops receiving messages may still represent an unresolved customer problem.

How often should support chatbot answers be reviewed?

Review conversations regularly, especially during the early operating period and after a source, policy, or routing rule changes. Use actual conversations to identify new questions and recurring errors. There is no useful schedule that replaces checking the current risk and volume of your support workflow.

If you are choosing a build approach, compare the work of maintaining knowledge and human handoffs with the work of building and maintaining a custom implementation. Explore support chatbot options or try momo free if a shared inbox and answers grounded in your own content fit your workflow.

Try a support chatbot

Try momo free with a website widget, knowledge sources, and a shared helpdesk inbox.

Try it free
Create a Chatbot for Customer Support: Step-by-Step Guide