Order Reminder Events were missed on 9/15/2025

Incident Report for Ordergroove

Resolved

The remediation has been successfully completed. All missed Order Reminder events for the September 15 run have been replayed, with safeguards in place to prevent any stale actions. The September 16 run has executed successfully as well, and we expect future runs to proceed smoothly starting tomorrow.

We will conduct a post mortem to strengthen monitoring for this process going forward.

Thank you for your patience as we resolved this issue.
Posted Sep 16, 2025 - 23:08 EDT

Monitoring

Order Reminder Events 9/15/2025:
Yesterday, on 9/15/2025, Order Reminder events were not sent to Klaviyo or delivered through Ordergroove Webhook system

What happened
We upgraded our queueing system for the application that produces Order Reminder events. During the upgrade, a subset of consumers did not update correctly and were listening to the wrong system, which caused events to be missed.

What we’re doing
We are carefully replaying all missed Order Reminder events today.
To avoid outdated actions, reminders will only be sent if the related order has not already been attempted.
We expect the remediation will be fully completed today

Next steps
Once remediation is complete, we will run an internal post mortem to strengthen monitoring and ensure full coverage of the process going forward.
Posted Sep 16, 2025 - 15:40 EDT