PIING
Reading Piing: AlertsA/B testing
Piing: Alerts
- Getting started with Piing: Alerts
- Appearance and branding
- Create and manage notifications
- A/B testing
- Frequency capping and suppression
- AI notifications
- Web push
- Segments and audiences
- Signed-in vs signed-out targeting
- Automations
- Analytics and suggestions
- Integrations and data
- FAQ and troubleshooting
- Plans and billing
In this guide
- Set up a test
- How visitors are split
- Reading the result
- After a winner appears
- Tips
Search or browse documentation
Piing: Alerts 4 / 14
A/B testing
Split-test copy and images across up to five variants and let the numbers pick the winner.
Split a notification across two or more versions and let the numbers pick the winner. A/B testing lives inside the notification editor.
Starter runs one live test at a time. Growth and Scale run as many at once as you like. See Plans and pricing.
Set up a test
- Open a notification, or create one.
- Write your main card as usual. This is Variant A, the control.
- Scroll to A/B test and tick Run an A/B test on this notification.
- Click Add variant to add Variant B. Fill only the fields you want to change: title, body, CTA label, chip, link, or image.
- Add up to four alternatives (B, C, D, E). Save.
Any field you leave blank on a variant inherits from A. So you can test a single headline while everything else stays fixed.
How visitors are split
Assignment is deterministic and sticky per visitor. A shopper always sees the same variant on repeat visits, and the served variant is stamped onto every impression, click, and conversion. The split is even across the pool.
Why it matters: a returning customer never sees the card flip between versions, and every event ties to the exact variant that earned it.
Reading the result
Open Analytics. Notifications running a split appear under A/B tests with per-variant impressions, clicks, CTR, conversions, and revenue.
A winner is called once the leading variant clears 30 impressions. Piing: Alerts ranks by conversion rate when any variant has conversions, and by click-through rate when none do yet. Until then the test shows Gathering data and every variant's numbers, with no winner crowned.
After a winner appears
The winner is advice, not an automatic switch. Traffic keeps splitting so the result stays honest. When you're satisfied, open the notification, copy the winning version into Variant A, and turn the test off. The card now serves the winner to everyone.
Tips
- Test one thing at a time. Change only the headline, or only the image.
- Give it volume. Thirty impressions is the floor for a winner, not a target. Let a real test gather more.
- Keep variants properly different. Two near-identical lines rarely separate.
Related guides
Was this guide helpful?
Next guide in Piing: Alerts
Frequency capping and suppression
Stop a card repeating after it has done its job with conversion suppression, impression caps, and cooldowns.
Still need a hand? Contact us