2019-12-05T14:20:27.693814+00:00
Incident impacting MONTREAL DATA CENTRE

The farleymowat cluster has been stable since 1:18PM ET. We will provide another update tomorrow afternoon once we have full details from the data centre re. the hypervisor issue & why it didn't failover. We will also be contacting all clients to arrange site migrations to a new cluster, as the farleymowat cluster has proven to be unreliable over the last 30 days.

Status changed to
Fully Operational
2019-12-05T22:28:34.524472+00:00

Sites are serving. We will be contacting clients directly re. migrations to a more reliable cluster. We will also have more details listed here later this afternoon once we get full disclosure from the data centre.

Status changed to
Degraded Performance
2019-12-05T18:38:39.761170+00:00

IMPORTANT - farleymowat cluster is up. More details shortly on the migration process & failover A records.

Status remaining
Major Outage
2019-12-05T18:21:41.768365+00:00

We will provide another update at approx. 1PM ET with any additional details that we have from the data centre or our emergency response team.

Status remaining
Major Outage
2019-12-05T17:46:06.080472+00:00

The data centre has now missed the ETA & we have been given another ETA of 1 hour. We're now starting the process of restoring backups to a new cluster, as a precaution if the ETA is missed again. We apologize for this issue & appreciate the patience that our clients have shown us this morning.

Status remaining
Major Outage
2019-12-05T17:34:32.261051+00:00

We're awaiting an update from the data centre on the status of resolution. Will post here once we have that. We continue to respond to clients who are requesting to point to a failover server. Our sysadmins are also following our emergency plans & prepping a new cluster. More details once we have them.

Status remaining
Major Outage
2019-12-05T16:44:41.012147+00:00

The data centre has reported that they are still working on resolving the issue. They have provided an approx. ETA of 1 hour for it to be resolved. Please note that this could change, as they are progressing through troubleshooting steps. We have failover servers in place that contain cloned copies of sites. If you would like to point your site to those servers, please contact us via support.

Status remaining
Major Outage
2019-12-05T16:01:23.737984+00:00

At this time, the data centre team is still trying to resolve the issue with the hypervisor. We hope to have an update with an ETA shortly.

Status remaining
Major Outage
2019-12-05T15:27:31.515861+00:00

The data centre team is still working on the issue. We do not have an ETA at this time. We kindly ask that clients do not create support tickets asking for an ETA, as we will post any updates here. Next update will be at approx. 10:15AM ET

Status remaining
Major Outage
2019-12-05T14:56:08.845536+00:00

The data centre team is investigating the issue, which appears to be the result of a hypervisor failing. We will post another update here in 15 minutes.

Status remaining
Major Outage
2019-12-05T14:39:29.489052+00:00

We're currently investigating an issue with the farleymowat cluster. Will post more details once we get a report from the data centre.

Status changed to
Major Outage
2019-12-05T14:20:27.693846+00:00
Back to Current Status