Pin Payments outage, March 2019: Increased error rate due to upstream networking issues

Pin Payments reported and resolved an incident: Increased error rate due to upstream networking issues. It lasted 11.7 hours.

Resolved

From Pin Payments's official status page, in their words.

What happened

Started
Resolved
Duration
11.7 hours
Impact
none
Affected
API, Subscriptions
  1. Investigating
  2. Identified
  3. Monitoring
  4. Resolved

Why it happened

Pin Payments has not given a cause in its updates. We never guess one.

How it was resolved

Pin Payments marked it resolved at 31 Mar 2019, 10:17 am without a written explanation of the fix.

This incident on the Pin Payments status page

Timeline

Oldest first, from the first notice to the resolution. From Pin Payments's official status page, in their words.

  1. investigating

    An upstream provider has confirmed networking issues on their end. This will increase charge errors for Pin Payments merchants until the issue is resolved. A team is currently working to resolve the issue.

  2. investigating

    We are continuing to investigate this issue.

  3. identified

    Our upstream provider has indicated the issue is ongoing, they have allocated further resources to resolving the issue but it is unclear at this time how long it will take to return services to fully functional.

  4. monitoring

    Upstream services have been restored with enough resource to meet demand for the coming day. Pin Payments will continue to monitor the situation.

  5. resolved

    Transactions are processing normally again.

What this means for a business (and what to check now)

  • Retry anything that failed during the 11.7 hours.
  • Enter any payments, bookings or jobs you took another way.
  • If a deadline fell inside the window, keep this page as your record of the outage.

The full guide: what to do when a service you rely on is down

Other Pin Payments incidents

Hear about the next Pin Payments incident as it starts

Free email alerts when the official status changes, with what to do while it is down.