Bytemark cloud storage server "tail19" down

Expected resolution: We are currently investigating.
Return to issues
Issue status: Resolved Date:

28 May 2018
08:58 UTC

Posted by:

Ian Chilton

All of the discs migrated off over night and the affected tail is now empty.

If you are experiencing any problems, do let us know.

Issue status: Monitoring Date:

28 May 2018
00:25 UTC

Posted by:

Ian Chilton

We're still continuing to empty the affected tail.

We were seeing very odd, high memory usage on it, but after cleaning up some rogue state and migrating some of the discs off, that's stabilised now.

We'll continue to monitor and migrate the discs away through the night.

Issue status: Monitoring Date:

27 May 2018
21:33 UTC

Posted by:

Timothy Frew

We believe we've resolved the problem and are monitoring the situation. We're going to migrate discs to another tail 'storage server' as a precaution.

If you think this problem is still impacting your services at Bytemark, please do get in touch.

Issue status: Investigating Date:

27 May 2018
21:15 UTC

Posted by:

Timothy Frew

A storage server "tail19" has suffered some unexpected downtime. This server houses a number of "sata" grade discs for the Bytemark Cloud platform. You might be affected if your server has any of its discs on this tail.

We are rebooting the machine at the moment and it should return shortly. At this point we'll begin the process of emptying this particular storage server.

If you're experiencing any problems with your services at Bytemark that you think might be related, please do get in touch.

Expected resolution time updated: We are currently investigating.

Return to issues

Issue still not addressed? Please contact support.