Getting Started
1. Connect Your WhatsApp Number
In the UserTrace dashboard, navigate to Agent Setup and select WhatsApp Integration. Required Information:- WhatsApp Business number (with country code)
2. Set Evaluation Context
Define your pass and fail criteria for what constitutes successful interactions: Example Pass/Fail Criteria:Important Simulation Details
Sequential Testing
How it works:- Simulation 1 completes entirely before Simulation 2 starts
- Each simulation appears as a separate conversation thread
- No message overlap or confusion between different test scenarios
Test Number Management
Our Test Number: All simulations will come from a designated UserTrace phone number. This number will:- Send messages as different personas
- Complete full conversation scenarios
- Reset between simulations for clean testing
Best Practice: Use Sandbox Environment
Recommended Approach: Use your WhatsApp sandbox number instead of your production number to avoid any concerns about triggering real business actions during testing.
- Booking confirmations - Don’t create real reservations
- Payment processing - Don’t charge actual money
Best Practices
Response Timing
Natural Conversation Flow• Respond within 30 seconds for best results
• Use typing indicators if available
• Handle message bursts gracefully
• Handle message bursts gracefully
Message Handling
WhatsApp Features• Support media messages (images, voice)
• Handle quick reply buttons
• Use structured messages when appropriate
Testing Process
Inbound Agent Testing
For agents that respond to incoming messages:- Our test number sends the first message to your WhatsApp
- Your agent responds based on the scenario
- The conversation continues until completion
- Results are analyzed and scored
Outbound Agent Testing
For agents that initiate conversations (outbound messaging):- UserTrace sends a webhook request to your system
- Your agent initiates the conversation by sending the first message
- Our simulated user responds according to the scenario
- The conversation continues until completion
- Results are analyzed and scored
2. Between Simulations
- 30-second delay between different scenarios
- New conversation thread starts fresh
- Previous context is cleared
3. View Results
Each simulation provides:- Complete conversation transcript
- Response time analytics
- Success/failure against your criteria
- Persona-specific behavior analysis
Common Scenarios
Customer Service Examples:- “My order is late, where is it?”
- “I want to cancel my subscription”
- “The food was cold when delivered”
- “I was charged twice for my order”
- “What’s your most popular dish?”
- “Do you deliver to my area?”
- “I have food allergies, what can I eat?”
- “What are your hours today?”
Troubleshooting
Common Issues:- Messages not delivering: Check WhatsApp Business API status
- Slow responses: Optimize your webhook response time
- Test actions triggering: Verify blacklist implementation
- Conversation mixing: Ensure proper thread management
Need help with WhatsApp setup? Our team can assist with Business API configuration and testing best practices. Contact [email protected].Next Steps: Create test scenarios for your WhatsApp agent and run simulations to validate performance.