LOTRO unavailable: Saturday March 30th

[Bara/Barzaram/Barwise]

We are continuing to work to resolve issues at our data center. At this time we do not have an ETA to provide, but we will keep you updated.

Thank you for updating us to let us know you are continuing to work on it for as long as humanely possible until the problems are resolved.
we will be patiently waiting = )

 

[Tarbel]

Thanks Cord!

 

[maartena]

Can any please recommend a way to get an alert when the servers or game is back up. I'm leaving no more waiting around.

You've actually been waiting?

 

[Faenlanthir]

We are continuing to work to resolve issues at our data center. At this time we do not have an ETA to provide, but we will keep you updated.

Thanks for continuing to update! Eagerly awaiting the fix!

 

[maartena]

We are continuing to work to resolve issues at our data center. At this time we do not have an ETA to provide, but we will keep you updated.

Pro tip from someone that has worked in IT for 25+ years and have had my fair share of major outages that cost me a whole weekend or more..... feed your crew! Even if they work from home, get Severlin to pull his company credit card and send some doordash to the engineers working on this issue..... Working on an empty stomach to get stuff back up and running asap is..... brutal. Send them each a pizza, so they (and their families) can at least have a small break.....

 

[Thris]

Pro tip from someone that has worked in IT for 25+ years and have had my fair share of major outages that cost me a whole weekend or more..... feed your crew! Even if they work from home, get Severlin to pull his company credit card and send some doordash to the engineers working on this issue..... Working on an empty stomach to get stuff back up and running asap is..... brutal. Send them each a pizza, so they (and their families) can at least have a small break.....

If I still lived in Boston, I'd have shown up at their office this morning with pizza and soda. I hope they have been well fed all day.

 

[maartena]

AFAIK they are in Needham. Adjacent to Boston, MA

At least if there had been no move in the last years.


Greetings, Polymachos

Office is in Needham, MA.
Datacenter is in New Jersey.
The engineers..... largely work from home using VPN.

They will have "smart hands" available at the data center though for emergencies, such as physical power downs etc, in case their remote access to do so is not working.

 

[Skedoosh]

We are continuing to work to resolve issues at our data center. At this time we do not have an ETA to provide, but we will keep you updated.

these updates are quite appreciated. best of luck to the team chasing log files and graphs on a saturday

 

[MerlynAC]

I read the DDO servers are also included in the outage.
X message from 37m ago: "We are continuing to work to resolve an outage at our data center. At this time we do not have an ETA, but we will keep you updated."

 

[Lins]

Given tomorrow is Easter Sunday I say spend it with family and fix Monday.

 

[Harvain]

I read the DDO servers are also included in the outage.
X message from 37m ago: "We are continuing to work to resolve an outage at our data center. At this time we do not have an ETA, but we will keep you updated."

Yeah, both of SSG's MMOs have been down.

It's why it's funny seeing some of the conspiracy theories on both MMOs. Yeah, it's CLEARLY just LOTRO being the issue and they are keeping DDO down too just to make it seem like it's not on their end.

Or how the DDO Forums have been going on about how it's Data Line which got impacted or a Storm caused this.

 

[istvana]

or a Storm caused this.

Weather near the servers has been pretty calm today.

 

[Kaewin]

or a Storm caused this.

Why do the X-Men always get blamed for things. Just wrong

 

[orologio]

I got a lot of housework done while waiting for LotRO to come back up, Thanks for the little nudge Cord & Co. : )

Ahhh but watcha gonna do for a week or 2 lol

 

[RedRiverProfessor]

Thank you for updating us to let us know you are continuing to work on it for as long as humanely possible until the problems are resolved.
we will be patiently waiting = )

You know there is no more green left to touch when this guy logs into the forums!

 

[FoxFire]

Well.... This is certainly going to require a Festival extension.

 

[AtraxSicarius]

What can men do against such reckless hate?

 

[maartena]

Well.... This is certainly going to require a Festival extension.

I think by now that’s a given. The outage has certainly been long enough for at least a day, but I would think at least 2 days. That’s not a big deal though, they can add a few days on the fly.

 

[Harvain]

Weather near the servers has been pretty calm today.

Which is what makes people trying to think of what caused this even funnier. It's been interesting seeing peoples reactions when they have only 2 bits of info: The Games are down and SSG is dealing with their Data Center.

I've been relaxing all day, helping prepare for Easter Sunday, and playing Helldivers 2 while fighting back the Automaton menace. The fight for Malevelon Creek continues.

 

[Pike]

No gripes from me. SSG is THE party most interested in getting this thing running and the stress can be enormous with these events.

When I was a maintenance manager, the stress was MASSIVE when people were waiting on you to make repairs. I remember getting called into the big man's office more than once for reprimands for going off on worker bees wanting their repairs done ASAP.