Media Temple Customers

A blog by (mt) for (mt) customers

Posts Tagged ‘fail

Cluster 2 Back, Customer Care, Migration Recap

with 6 comments

So Cluster 2 was back online after 8+ hours of downtime in my case, and still down in some other  peoples cases. My Account Center is still locked out after 19+ hours and some sites of mine have errors that I can’t seem to troubleshoot due to the Account Center Lockout. 

picture-2

I got a phone call from Andrew, a Customer Service V.P. at Media Temple whom I have spoken to before, here are some points that were addressed.

“What percentage of Cluster 2 customers have been migrated to Gen 2 architecture?”

Andrew: “44% of Cluster 2 Customers have been moved.”  (which is the same as it was back on March 6th)

Brennan: “Wow!”

Andrew: “We just finished our Fiji Agent last friday. This will speed up the process.”

“Why was no one moved during the last two months? Or at least why was whiny little bitch customers like me not moved, even after I asked to be moved after the 36 hours of downtime?”

Andrew: “We had faith that the Cluster 2 hardware would be ok.” 

Brennan: “Seriously? You had faith that after 36 hours of downtime [the same hardware setup] would be ok?” 

Andrew: “Well, let me rephrase that. We wanted to make sure we were making the best decisions to migrate people at the best times so there would be minimal amounts of downtime” …and… “we have been putting all of our resources and developers into  the Fiji Agent.”

Brennan: “Wow! Too bad this had to happen.”

Media Temple claimed to be on a “road to better transparency” something about this doesn’t feel transparent to me. I said “Transparency doesn’t mean talking more, it means being honnest”

Andrew: “We haven’t been dishonest about anything.”

While technically that might be true. Media Temple did claim on March 6th that:

Next 30 days, Cluster-to-Cluster migration tools. We have committed significant developer and administrator manpower to the development of Cluster-to-Cluster migration tools.”

I understand. Software development does sometimes take longer than anticipated…

But for some reason I am inclined to say bullshit. If it looks like a bull and smells like shit it’s probably bullshit. I seem to remember around the time of SXSW (March 17th), during the absurdly long period (1.5 weeks) of POP email server IP blacklisting, there was a lot of Tweets about how amazing the Media Temple SXSW party was. In fact they threw The Official Closing Party for the SXSW Interactive Festival. This party was replete with international music groups, an open bar, a photo booth, and a mechanical bull. 

sxsw_bull

Maybe I’m off base here, but I imagine throwing a party of that scale takes time to organize and a substantial budget to pay for. Oddly, I don’t see the correlation between mechanical bulls and fixing unstable web servers but maybe that’s just me.

In hindsight, considering this new downtime debacle, and the facts, I have to ask the question: How much of Media Temple’s resources were devoted to getting frustrated customers to a more stable hosting platform like their Gen 2 architecture? 

Oh, Andrew also offered to move my sites within the hour to Cluster 4 so I could use the Account Center… this however could result in more patches of downtime… I wonder if they understand that downtime during the middle of the day is a bad thing for websites? I said “How about you do that later tonight.”

**The quotes may not be exact as I didn’t have an audio recorder handy. I tried my best. 

Written by bnvk

May 5, 2009 at 6:23 pm

8+ Hours Of Downtime

with 13 comments

After 4+ hours of unexpected server downtime, a couple irate clients, 1 semi angry Tweet I received a call from  customer service at Media Temple. She wanted to know if I had any questions…

My only question was:

“What percentage of Cluster 2 customers have been moved from Gen 1 architecture to Gen 2 architecture”

This customer support lady didn’t know the answer to that question. She put me on hold to try to get the answer. After a few minutes waiting she said “they have no way of knowing exactly.”

That was the wrong answer. Because now I am left feeling that Media Temple either has no clue about what they’re doing or they are not being honest. How can I jump to this conclusion? Well on March 6th 2009, following the 36+ hours of downtime, Media Temple made this blog post: Anatomy of Storage on the GRID

It explained all the old architecture (Gen1 ) and new architecture (Gen 2). 

2gens

This blog post also claimed:

“At time of writing, 37% of Cluster 1 customers, and 44% of Cluster 2 customers have already been migrated.”

So I am forced to really wonder how 2 months later they don’t know at all… I mean 80% or 70% percent would have been undesirable answers but “We have no way of knowing” is kind of absurd. They didn’t project to be done with until June but what I am left to think now?  

In either case I  getting very very distrustful with them as a hosting company. I was one of the customers affected by the 36 hours of downtime staring Feb 28, 2009. I had setup this blog. I got a lot of attention for rallying the twitter/blog-o-sphere. Back then I got a phone call from a V.P. at Media Temple followed by personal phone number for V.P. at Blue Arc (mt hardware supplier). They both sorta blamed the other for the downtime. Fair enough. It still sucked. I didn’t want to go through the headache of moving to a new ISP and I was appeased by some PR people- they gave us all free hosting for a month. But now another HUGE outage is just unacceptable. 

 

 

Written by bnvk

May 5, 2009 at 4:09 am

Defending your brand in the age of social media. What we can learn from the Mediatemple outage.

leave a comment »

mtfail

In the world we live in your brand, company, and product are under such scrutiny in so many ways that most companies can’t even begin to fathom the repercussions of their actions.

Over the weekend Media Temple who hosts my blog(The Retrospective) went down unexpectedly (or so I was lead to believe). Now when this occurred, I wasn’t notified for almost 4 hours! Eventually, some generic email was sent out barely eluding to the shear scale of the issue. A quick call to tech support (they are so lucky humans run this or it would of been even MORE disastrous) told me I would be up in about 30 minutes.

30 plus hours later–our blog is STILL down! I’m losing traffic and money like it’s going out of style (We’re in a recession people, websites can’t be going down like this). Almost as instant as our blog went down every facet of social media began banding together to exude every frustration they had bottled up. People as far as Australia were contacting me on Twitter to tell me of their woes. Companies can no longer hide the way they used to when things go sour. Back in the day you could quietly make mistakes (this is a huge FAIL) and no one would be the wiser. Look at Pepsi, they just reverted back to their old Tropicana design after hundreds of blogs, tweets, and comments unanimously exiled the new design.

Like our new president, companies need to be transparent and allow almost full disclosure when they make mistakes or are in the wrong. At the end of the day you have to remember everything is amazing and nobody’s happy, especially not me.

Written by Gitamba Saila-Ngita

March 2, 2009 at 2:57 am