Cloud Servers down on a few York heads

Expected resolution: 11 May 2018, 16:00 UTC
Return to issues
Issue status: Resolved Date:

12 Mar 2018
09:07 UTC

Posted by:

Jamie Nguyen

We've taken the 4 affected heads out of rotation (head66/67/68/69). We're still investigating the root cause but the rest of our York Cloud Server infrastructure is stable. We do apologise to anyone affected yesterday.

Issue status: Monitoring Date:

11 Mar 2018
16:26 UTC

Posted by:

Jamie Nguyen

All Cloud Servers that were down should now be back online again.

Please do get in touch if you've got any continuing problems.

Issue status: Investigating Date:

11 Mar 2018
15:49 UTC

Posted by:

Jamie Nguyen

This is proving to be more complicated than initially feared. Some Cloud Servers in York are turning off unexpectedly. We're investigating hard to get to the bottom of the problem while also bringing your Cloud Servers back online where we can. Thanks for bearing with us.

Expected resolution time updated: 11 May 2018, 16:00 UTC

Issue status: Investigating Date:

11 Mar 2018
14:40 UTC

Posted by:

Jamie Nguyen

While initially it looked like it was an issue specific to head69, on further investigation it's actually tail54 that was the issue. (Tails are the physical machines that hold the virtual discs for your Cloud Servers.)

Now that we're on the right track, we're continuing to bring affected Cloud Servers back online.

Issue status: Investigating Date:

11 Mar 2018
14:25 UTC

Posted by:

Jamie Nguyen

Unfortunately, head67 and head68 seem to be affected by the same issue too. We're working on restoring service as soon as possible!

Expected resolution time updated: 11 May 2018, 15:00 UTC

Issue status: Investigating Date:

11 Mar 2018
14:06 UTC

Posted by:

Jamie Nguyen

About half of the Cloud Servers that were affected are back online. Thanks for bearing with us while we get the remaining servers back online!

Expected resolution time updated: 11 May 2018, 13:30 UTC

Issue status: Investigating Date:

11 Mar 2018
13:34 UTC

Posted by:

Jamie Nguyen

We've been alerted to an issue with head69, a physical machine on our Cloud infrastructure.

You might be affected if you notice your Cloud Server has suddenly turned off and you can't turn it back on again.

I'm not yet sure why this is happening, but I'm taking head69 out of rotation and currently starting your Cloud Servers up on other heads.

If you're experiencing any problems with your services at Bytemark that you think might be related, please do get in touch.

Expected resolution time updated: 11 May 2018, 13:00 UTC

Return to issues

Issue still not addressed? Please contact support.