Well, it’s nearly over, but that was the kind of day that CTOs tell their children at night if they want them to be daredevil stuntmen when they grow up instead.
Starting at around 6pm last night, we started experiencing beeeg trouble with our main disk array. All the alarms went off, and Mike, our Techy Infradoodads Manager dashed down to Brick Lane to recover it from the backup. It took almost about 20 hours to get the site fully operational (direct uploads were particularly stubborn) but things are now fine again.
I’m sorry to everyone who tried to place orders today and had trouble -we had a number of false starts where we thought we had it working and then it went wrong again. It must have been even more frustrating for you than for us.
There are a number of people whose orders may be in an incomplete state – we know who you are, and we’ll be contacting you to sort things out over the next day or so.
The mantra we have at MOO is to never let the same thing go wrong twice- this is the first severe non-scheduled outage we’ve had since we launched 14 months ago, but we already know the fixes we need to make to prevent it in future.
I’d like to repeat: I’m really sorry, and it won’t happen again.
Now, pizza has arrived.
Awww… I’ve been waiting since to order since September… and finally decided to go ahead… placed the order and now this happens.. Well, anyway, thanks for being honest and letting us know — and enjoy the pizza!
May the Blessing of Christmas find your heart open to receive it.
You guys are awesome!
Oh I just sent you a nasty email about trying to order today 11/30 dont take offense – I didnt see you were still having issues. Hope it gets resolved soon!
I still can’t place orders. Nothing happens when I click on preview orders. I’ll take my Christmas present buying elsewhere now.
Some kind of message on the order page saying the system was/is still shagged might have made my life easier besides having to find a blog post saying everything is working ok when it isn’t.
But I am still having problems trying to place my orders. Keep up the good service, guys!
We know that lots of you are great ambassadors for MOO and so we've been thinking of a way to say thank you. Which is why you can now actually earn money off your next order when you refer friends to MOO.Find out more
If you can do us a favour, we'll do one for you in return. Sign up as an affiliate and you could earn up to £5, $8, or €6 for every new customer you send our way.Sign up now