Pin Payments outage, June 2019: Connectivity issues & errors

Pin Payments reported and resolved an incident: Connectivity issues & errors. It lasted 1 minute.

Resolved

From Pin Payments's official status page, in their words.

What happened

Started
Resolved
Duration
1 minute
Impact
none
  1. Investigating
  2. Identifiednot posted
  3. Monitoringnot posted
  4. Resolved

Why it happened

Pin Payments has not given a cause in its updates. We never guess one.

How it was resolved

Around 24 June 2019 2230 AEST merchants may have experienced errors and connectivity issues using the Pin Payment platform and site. Whilst we could detect the issues none of our systems seemed to be experiencing any difficulties. It was not long until we realised the internet was behaving unusually. It turns out that due to an error in the United States a significant proportion of the internet was affected by changes in the shared routing (navigation) information. This led to a myriad of odd software behaviour accross the internet and unfortunately also affected the Pin Payments platform. Once we realised what was going on and established that we could do nothing about it, the problem was solved by those upstream who were in a position to do so. For a more in-depth explanation of what happened and how the problem was rectified one can read further here https://blog.cloudflare.com/how-verizon-and-a-bgp-optimizer-knocked-large-parts-of-the-internet-offline-today/

Pin Payments's closing update

This incident on the Pin Payments status page

Timeline

Oldest first, from the first notice to the resolution. From Pin Payments's official status page, in their words.

  1. resolved

    Around 24 June 2019 2230 AEST merchants may have experienced errors and connectivity issues using the Pin Payment platform and site. Whilst we could detect the issues none of our systems seemed to be experiencing any difficulties. It was not long until we realised the internet was behaving unusually. It turns out that due to an error in the United States a significant proportion of the internet was affected by changes in the shared routing (navigation) information. This led to a myriad of odd software behaviour accross the internet and unfortunately also affected the Pin Payments platform. Once we realised what was going on and established that we could do nothing about it, the problem was solved by those upstream who were in a position to do so. For a more in-depth explanation of what happened and how the problem was rectified one can read further here https://blog.cloudflare.com/how-verizon-and-a-bgp-optimizer-knocked-large-parts-of-the-internet-offline-today/

What this means for a business (and what to check now)

  • Retry anything that failed during the 1 minute.
  • Enter any payments, bookings or jobs you took another way.
  • If a deadline fell inside the window, keep this page as your record of the outage.

The full guide: what to do when a service you rely on is down

Other Pin Payments incidents

Hear about the next Pin Payments incident as it starts

Free email alerts when the official status changes, with what to do while it is down.