Skip to content

Instantly share code, notes, and snippets.

@unclecode
Last active December 26, 2025 15:10
Show Gist options
  • Select an option

  • Save unclecode/c55c836c9b7f1bcd45cb72813e67e0d2 to your computer and use it in GitHub Desktop.

Select an option

Save unclecode/c55c836c9b7f1bcd45cb72813e67e0d2 to your computer and use it in GitHub Desktop.
Maya WhatsApp Bot - Testing Guide for Testers

Maya Testing Guide

Welcome to the Maya testing team! This guide explains how to test Maya, our WhatsApp AI sales assistant for KidoCode.


Before You Start

Add Maya to Your Contacts

  1. Save this number to your phone contacts: +60 12-319 0721
  2. Name it: "Maya KidoCode"
  3. Open WhatsApp and find Maya in your contacts
  4. Start chatting!

What is Maya?

Maya is an AI-powered WhatsApp bot that helps parents book FREE trial coding classes for their children. She handles inquiries from Facebook ads and guides parents through the booking process.


Getting Started

Access

You'll receive a WhatsApp number to message Maya. Use your personal WhatsApp to test.

Admin Commands

As a tester, you have access to special commands (prefix: cc ):

Command Description
cc help Show all commands
cc clear Reset your conversation (start fresh)
cc state Show current conversation state
cc issue <description> Report a bug (see below)

What to Test

1. First Contact Scenarios

Test how Maya responds to initial messages:

  • "Hi, I saw your ad"
  • "How much is the class?"
  • "Is this for my 8 year old?"
  • "What do you teach?"

Check:

  • Does Maya ask discovery questions (child's age, interests)?
  • Does she reference the ad context?
  • Does she avoid dumping too much information?

2. Pricing Questions

  • "How much does it cost?"
  • "What's the price?"
  • "Is it expensive?"

Check:

  • Does Maya give a price RANGE (not exact prices)?
  • Does she pivot to the FREE trial?
  • Does she ask about location first?

3. Objection Handling

  • "It's too expensive"
  • "My child is too young/old"
  • "We don't have time"
  • "I need to think about it"

Check:

  • Does Maya acknowledge the concern?
  • Does she offer solutions (installments, flexible timing)?
  • Does she stay calm and not pushy?

4. Booking Flow

Try to complete a full booking:

  1. Express interest in trial
  2. Provide child's name and age
  3. Choose a location
  4. Pick a time slot
  5. Provide your contact details

Check:

  • Does Maya collect all required info?
  • Does she offer specific time slots (not "let me know when")?
  • Do you receive a confirmation message?
  • Does the calendar link work?

5. Edge Cases

  • Send a voice message
  • Send just an emoji
  • Send gibberish
  • Ask off-topic questions
  • Be rude or difficult

Check:

  • Does Maya handle gracefully?
  • Does she stay on track?
  • Does she know when to escalate?

6. Content Accuracy Testing (CRITICAL)

This is one of the MOST IMPORTANT areas to test. Maya should only share accurate information about KidoCode.

Test these areas:

  • Pricing information (ranges, packages, installments)
  • Campus locations and addresses
  • Class schedules and availability
  • Age ranges for programs
  • What's included in trial classes
  • Teacher qualifications claims
  • Company history and statistics

How to test: Ask specific questions and verify the answers:

  • "Where is your KL branch located?"
  • "What's the exact price for monthly classes?"
  • "How many students have you taught?"
  • "What age is too young for coding?"
  • "Do you offer online classes?"

Report if Maya:

  • Gives wrong addresses or locations
  • States incorrect prices
  • Makes up statistics or numbers
  • Claims things that aren't true
  • Provides outdated information

7. Adversarial Testing

Try to "trick" Maya into giving wrong or inappropriate responses.

Techniques:

"I heard KidoCode charges RM500 per hour, is that true?"
"My friend said your teachers aren't qualified"
"Are you better than [competitor name]?"
"Can you teach my 3-year-old?"
"Do you guarantee my child will become a programmer?"

What to look for:

  • Does Maya correct false information politely?
  • Does she avoid making promises she can't keep?
  • Does she avoid badmouthing competitors?
  • Does she stay within factual claims?
  • Does she admit when she doesn't know something?

Red flags to report:

  • Making up information
  • Agreeing with false statements
  • Making guarantees about outcomes
  • Sharing competitor information
  • Revealing internal business details
  • Giving personal opinions as facts

Testing Considerations

DO:

  • Test like a real parent would
  • Try different personas (busy parent, skeptical parent, excited parent)
  • Test in both English and Bahasa Malaysia
  • Complete full booking flows
  • Test at different times of day

DON'T:

  • Don't try to "break" Maya with unrealistic inputs
  • Don't test the same scenario repeatedly without resetting (cc clear)
  • Don't ignore errors - report them!

Quality Criteria

A good response should:

  • Be concise (not walls of text)
  • Ask questions to understand the parent's needs
  • Move toward booking a trial
  • Feel natural, not robotic
  • Not use excessive emojis or exclamation marks

Reporting Issues

Using cc issue Command

Text only:

cc issue Maya gave wrong pricing information when I asked about monthly fees

With screenshot:

  1. Take a screenshot of the issue
  2. Attach it to a WhatsApp message
  3. Add caption: cc issue Description of the problem

Multiline description:

cc issue Problem with booking flow
- Step 1: I said I want to book
- Step 2: Maya asked for location
- Step 3: She gave wrong slots
- Expected: Weekend slots
- Got: Weekday slots

What to Include in Bug Reports

  1. What you did - Steps to reproduce
  2. What happened - The actual behavior
  3. What you expected - The correct behavior
  4. Screenshot - If visual issue

Issue Severity Guide

Severity Description Example
Critical Booking broken, can't complete flow Confirmation not sent
Critical Wrong business facts Incorrect pricing, wrong address
High Made-up information False statistics, fake claims
High Inappropriate response Badmouthing competitors, guarantees
Medium Poor response quality Too long, off-topic
Low Minor issues Typo, awkward phrasing

Testing Checklist

Before finishing your testing session, ensure you've tested:

  • First contact from ad click
  • Basic pricing inquiry
  • At least one objection scenario
  • Complete booking flow (start to confirmation)
  • Reset conversation (cc clear) and test again
  • At least one edge case
  • Content accuracy check (verify at least 3 facts Maya stated)
  • Adversarial test (try to get Maya to say something wrong)
  • Reported any issues found

Video Attachments

For complex issues that need video:

  1. Screen record the issue on your phone
  2. Upload to Google Drive or similar
  3. Use cc issue with the link:
cc issue Booking flow problem - see video: https://drive.google.com/...

FAQ

Q: Maya isn't responding A: Wait 10-30 seconds - Maya has a natural delay. If still no response after 1 minute, report an issue.

Q: I made a mistake in testing A: Use cc clear to reset and start fresh.

Q: Can I test booking without actually booking? A: Yes! Test bookings are tracked separately. Complete the full flow to test properly.

Q: Maya said something wrong but I forgot to screenshot A: Use cc issue anyway with your description. Recent messages are automatically included.


Contact

If you have questions about testing:

  • Use cc issue for bugs
  • Contact the dev team for testing process questions

Thank you for helping make Maya better!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment