Context-aware shipping message

Discover how refining free shipping messages impacted site behavior and conversion rates. Explore the lessons learned from this A/B test!

Metric

Conversion rate

Lift change

-5.5%

Context-aware shipping message – Control screenshot

Control

Context-aware shipping message – Variation screenshot

Variation

If we display only one clear, context-specific shipping message based on product price, then conversion rate will increase because users will better understand the shipping benefit for specific items.

What We Changed

  • Displayed only one context-aware free shipping message per product.
  • Used specific messaging based on product price.
  • Removed redundant shipping information.

Detailed breakdown

Conversion Rate

-5.5%

Add-to-Cart Rate

-1.0%

Average Order Value

-4.2%

Revenue

-8.6%

Bounce Rate

-4.0%

Key Learnings

  • Simplifying messages did not improve conversion as expected.
  • Reduced messaging may have decreased perceived value.
  • Context-specific messaging requires further exploration.