Server Rubberbanding and flying mobs reported back(Now 11 days and counting)... No fixes have worked

Slapshot1188

I hope they get this fixed ASAP since the DAWN expansion is supposed to hit in the next week or so...

 

http://www.mortalonline.com/forums/61623-what-wrong-server.html

Anubisan

I personally have not experienced this at all over the past few days and I have been playing quite a lot.

Slapshot1188

Originally posted by Anubisan

I personally have not experienced this at all over the past few days and I have been playing quite a lot.

 Interesting... it's obviously an issue for some as real fans like Cyde and even Tizio have experienced it but if you are able to play flawlessly perhaps it's something ISP related... in Sweden

 

Interesting...

funkmastaD

I noticed slight rubberbanding a couple days ago, seems fine after reboot.

 

 I wonder why OP always titles his threads as if he won't have a chance to get that info across in the body of the post.

Slapshot1188

Originally posted by funkmastaD

I noticed slight rubberbanding a couple days ago, seems fine after reboot.

 

 I wonder why OP always titles his threads as if he won't have a chance to get that info across in the body of the post.

 Interesting...  I just hope it gets fixed for everyone soon and doesn't interfere with DAWN.

Slapshot1188

Update from the CEO who promises to address the problem!

 

 

Today, 17:50

#97 (permalink)

Henrik Nystrom CEO     Join Date: Apr 2008

We are not ignoring this thread, hence I answered in it. We have a planned maintenance tomorrow including some updates on the server that may solve the issue we have atm. We have noticed a strange increase in one of our cpus on the server, without changing anything in the server. We have been online every now and then to try to see what the ingame experience is as it differs a lot for the players. We have noticed some things you describe when testing. It could be a few different things (hardware, software issues, internet connection) which we are going over at the moment, since no changed been made on the Mortal server codes its most likely something of the above mentioned, we simply need to go through them all. We are mostly focusing on Dawn but this requires our time as well, as you said, we dont want Dawn released with any current lagg issues. Thank you again for your feedback on this.

Jakdstripper

Originally posted by Slapshot1188

Update from the CEO who promises to address the problem!

 

 

Today, 17:50

#97 (permalink)

Henrik Nystrom CEO     Join Date: Apr 2008

We are not ignoring this thread, hence I answered in it. We have a planned maintenance tomorrow including some updates on the server that may solve the issue we have atm. We have noticed a strange increase in one of our cpus on the server, without changing anything in the server. We have been online every now and then to try to see what the ingame experience is as it differs a lot for the players. We have noticed some things you describe when testing. It could be a few different things (hardware, software issues, internet connection) which we are going over at the moment, since no changed been made on the Mortal server codes its most likely something of the above mentioned, we simply need to go through them all. We are mostly focusing on Dawn but this requires our time as well, as you said, we dont want Dawn released with any current lagg issues. Thank you again for your feedback on this.

 i stopped reading at "promise" 

Anubisan

It's a strange issue as it doesn't appear to be affecting everyone, but there definitely are a lot of people experiencing it. I'm just glad I'm not one of them at present...

*knock on wood*

raff01

Nice to see flying mobs are still on the menu.

Slapshot1188

Unfortunately so far they have been unable to fix the issue but we have confirmation from the Community Manager that the StarVault folks are going the extra distance and will be working today to try and resolve it.

 

Today, 05:30	#126 (permalink)
Black Opal Community Manager     Join Date: Mar 2011 Posts: 252	They will be coming in to the office Saturday in order to work on the issue, it has been narrowed down to a few things, expect some updates. __________________ Share MO with others Opal Mini Tracker

 

Keep your fingers crossed!

Slapshot1188

Damnit.. they had to cancel the King of the Hill Event due to the server situation...

 

 

5th May 2011, 23:38

#1 (permalink)

GM Gradius GameMaster     Join Date: Mar 2011

Capture The Flag Event King of the Hill - May This Friday there will be a King of the Hill event near Kranesh. The group holding the Flag Structure for 15 minutes will win the event and be rewarded. The hill will not be marked until the event starts. The area around the hill will be like the Tindrem Arena, everybody inside it will be grey flagged. Keep in mind that taking part in the event activities is at your own risk... The Rules: - Holding the flag structure for 15 minutes will end the event. - If the flag area is contested the timer will reset. - Yellow flag or naked players cannot trigger the timer. - More rules might be added before the event starts. The event has been cancelled, the new date & time will be announced soon.

This is really starting to look like it will impact the DAWN launch (estimated next week) as it's been a week and they haven't been able to resolve the issue yet.   Let's all keep our fingers cross that this week they find/fix the problem!

 

Slapshot1188

New Update:

 

 

Today, 03:33	#130 (permalink)
Black Opal Community Manager     Join Date: Mar 2011	We believe that the issue is actually the server hardware, abnormal temperatures were recorded in one of the servers, as well as the resources usage showing too low for what MO would normally require. Replacement parts for the servers have been ordered, and should arrive soon. __________________ Share MO with others

 

Go Go NEWEGG!!!!

HerculesSAS

Given that they outsource their servers from the hosting company, and that the hosting company uses SNMP to monitor fans, hard drives, temperatures, etc... this is TOTAL BS.

 

StarVault may own the servers, but they don't do the maintenance nor do they have to worry about it working. That's what they contract in their SLA to the hosting company. This is a standard hosting agreement, where the hosting company will monitor the servers and provide the "hands on" work because they are remote to SV.

 

Ordering new fans? You know that EVERY server (Dell, HP, IBM, etc) has monitoring systems within the server that throw indicator lights on the front or back (green for good, red for bad) to indicate that a fan has gone bad. And when they do go bad, the other fans spin FASTER to make up the difference until you get a replacement. Same with power supplies. The amount of redundancy in these systems is beyond what would make a server get too hot, and if the server did get too hot, it would simply turn off or die entirely due to thermal protection or a total overheat.

 

Oh, and for replacement parts for HP, Dell, and IBM... it's an ETA of 4-24 hours for most of Europe.

 

If you're going to make up a lie, at least know WTF you are talking about. But I expect no less from SV.

lethys

How do games like this even turn a profit, let alone retain players.  

Heretique

Originally posted by HerculesSAS

Given that they outsource their servers from the hosting company, and that the hosting company uses SNMP to monitor fans, hard drives, temperatures, etc... this is TOTAL BS.

 

StarVault may own the servers, but they don't do the maintenance nor do they have to worry about it working. That's what they contract in their SLA to the hosting company. This is a standard hosting agreement, where the hosting company will monitor the servers and provide the "hands on" work because they are remote to SV.

 

Ordering new fans? You know that EVERY server (Dell, HP, IBM, etc) has monitoring systems within the server that throw indicator lights on the front or back (green for good, red for bad) to indicate that a fan has gone bad. And when they do go bad, the other fans spin FASTER to make up the difference until you get a replacement. Same with power supplies. The amount of redundancy in these systems is beyond what would make a server get too hot, and if the server did get too hot, it would simply turn off or die entirely due to thermal protection or a total overheat.

 

Oh, and for replacement parts for HP, Dell, and IBM... it's an ETA of 4-24 hours for most of Europe.

 

If you're going to make up a lie, at least know WTF you are talking about. But I expect no less from SV.

As a datacenter administrator I approve this message. Just another beat around the bush, wonder if SV actually knows what is wrong.

Slapshot1188

Originally posted by HerculesSAS

Given that they outsource their servers from the hosting company, and that the hosting company uses SNMP to monitor fans, hard drives, temperatures, etc... this is TOTAL BS.

 

StarVault may own the servers, but they don't do the maintenance nor do they have to worry about it working. That's what they contract in their SLA to the hosting company. This is a standard hosting agreement, where the hosting company will monitor the servers and provide the "hands on" work because they are remote to SV.

 

Ordering new fans? You know that EVERY server (Dell, HP, IBM, etc) has monitoring systems within the server that throw indicator lights on the front or back (green for good, red for bad) to indicate that a fan has gone bad. And when they do go bad, the other fans spin FASTER to make up the difference until you get a replacement. Same with power supplies. The amount of redundancy in these systems is beyond what would make a server get too hot, and if the server did get too hot, it would simply turn off or die entirely due to thermal protection or a total overheat.

 

Oh, and for replacement parts for HP, Dell, and IBM... it's an ETA of 4-24 hours for most of Europe.

 

If you're going to make up a lie, at least know WTF you are talking about. But I expect no less from SV.

 I agree... BUT.. let's face it... nothng about this game has been done according to normal business practices, so I actually do not find the Community Manager's message very hard to believe.   I guess it really doesn't matter in the end though.  They need to fix the server, whatever is wrong, whoevers fault it is... it just had to get fixed.. fast.  A week is too long IMHO.

Ruellis

Originally posted by HerculesSAS

Given that they outsource their servers from the hosting company, and that the hosting company uses SNMP to monitor fans, hard drives, temperatures, etc... this is TOTAL BS.

 

StarVault may own the servers, but they don't do the maintenance nor do they have to worry about it working. That's what they contract in their SLA to the hosting company. This is a standard hosting agreement, where the hosting company will monitor the servers and provide the "hands on" work because they are remote to SV.

 

Ordering new fans? You know that EVERY server (Dell, HP, IBM, etc) has monitoring systems within the server that throw indicator lights on the front or back (green for good, red for bad) to indicate that a fan has gone bad. And when they do go bad, the other fans spin FASTER to make up the difference until you get a replacement. Same with power supplies. The amount of redundancy in these systems is beyond what would make a server get too hot, and if the server did get too hot, it would simply turn off or die entirely due to thermal protection or a total overheat.

 

Oh, and for replacement parts for HP, Dell, and IBM... it's an ETA of 4-24 hours for most of Europe.

 

If you're going to make up a lie, at least know WTF you are talking about. But I expect no less from SV.

 Hosting company monitoring the client servers´ fan speed, temperature using snmp? You may live in a perfect fantasy world, but I have never known one. Not even big corporates monitoring these on their own inhouse servers on a daily base.

The service level of the major server suppliers depends on the contrat you have. Usually it is within some working hour. Saturday and sunday happen to be out of the working hours. You are talking about things you have no idea at all. 

What actually communicated by Star Vault was: "We believe that the issue is actually the server hardware, abnormal temperatures were recorded in one of the servers, as well as the resources usage showing too low for what MO would normally require. Replacement parts for the servers have been ordered, and should arrive soon.". Who told you it was fan being replaced?

 

 

 

  

funkmastaD

Whew, backseat driving is tough.

Slapshot1188

Originally posted by Ruellis

 

 The service level of the major server suppliers depends on the contrat you have. Usually it is within some working hour. Saturday and sunday happen to be out of the working hours. You are talking about things you have no idea at all. 

 

 I agree.  The only problem with this statement is that the issue didn;t just pop up this weekend but actually started a week ago.  If there was a hardware fault I would hope that it would have been detected much sooner, but as you say the level of service from the host company is probably dependant on how much you are spending on it.  Given the financial situation of the company it seems likely that they wouldn't have the resources to pay premium dollar for topnotch support.

 

Anyhow... as I said above... it reeeeeeaaaalllly doesn't matter who's fault it is.. or even what the root cause is. All that matters is that it gets fixed... ASAP.

HerculesSAS

Originally posted by Ruellis

Originally posted by HerculesSAS

Given that they outsource their servers from the hosting company, and that the hosting company uses SNMP to monitor fans, hard drives, temperatures, etc... this is TOTAL BS.

 

StarVault may own the servers, but they don't do the maintenance nor do they have to worry about it working. That's what they contract in their SLA to the hosting company. This is a standard hosting agreement, where the hosting company will monitor the servers and provide the "hands on" work because they are remote to SV.

 

Ordering new fans? You know that EVERY server (Dell, HP, IBM, etc) has monitoring systems within the server that throw indicator lights on the front or back (green for good, red for bad) to indicate that a fan has gone bad. And when they do go bad, the other fans spin FASTER to make up the difference until you get a replacement. Same with power supplies. The amount of redundancy in these systems is beyond what would make a server get too hot, and if the server did get too hot, it would simply turn off or die entirely due to thermal protection or a total overheat.

 

Oh, and for replacement parts for HP, Dell, and IBM... it's an ETA of 4-24 hours for most of Europe.

 

If you're going to make up a lie, at least know WTF you are talking about. But I expect no less from SV.

 Hosting company monitoring the client servers´ fan speed, temperature using snmp? You may live in a perfect fantasy world, but I have never known one. Not even big corporates monitoring these on their own inhouse servers on a daily base.

The service level of the major server suppliers depends on the contrat you have. Usually it is within some working hour. Saturday and sunday happen to be out of the working hours. You are talking about things you have no idea at all. 

What actually communicated by Star Vault was: "We believe that the issue is actually the server hardware, abnormal temperatures were recorded in one of the servers, as well as the resources usage showing too low for what MO would normally require. Replacement parts for the servers have been ordered, and should arrive soon.". Who told you it was fan being replaced?

Server = hot means fans not working. It's simple, really.

 

As for the SNMP monitoring, for almost every colocation host they require the secondary NIC or ILO port to allow for SNMP traffic so they can monitor the servers. This is part of their SLA because SV has no "hands on" in the facility. This is so they don't have to run down the aisle every day just to look at servers, these things are automated for simple reasons ... it costs the hosting company LESS resources and allows them to be proactive (as the SNMP alerts will usually file a state of "degraded" in a warning before something up and dies).

 

The service level for *every* major server manufacturer is no more than 24 hours for the first 3 years for any mid-range server. That means the DL series+ in HP (as that's my familiarity) or any of the equivalents from Dell or IBM or anybody else. Why? Because when you're spending $5000+ on a server, then you expect a certain level of support. This isn't a "fantasy world" this is reality. Saturdays and Sundays *are*  part of working hours and part of the SLA for every major server company. How do I know? Because I've deployed projects in Germany, France, the UK, and Turkey for my organization; and I've never had an issue with worrying about support. It's not even "gold level" for most places -- gold level is 4 hours, silver (the default) is 24 hours as long as you get your request in before 5pm the same business day.

 

There really is no sense in debating this however, since you seem content to believe what any datacenter tech would know to be a flat out lie, and not even a good one. Even if a server was overheating, EVERY datacenter has the ability to pump cooling into the row to compensate until the "parts came in". What a crock.

kastrix

mortal online is starting to feel more and more like the inception car crash.

Slapshot1188

Two new updates from Lord Henrik the StarVault CEO.  It seems they have not found the problem yet.. they are now looking at the ports as a possible cause.

 

 

Today, 19:47	#174 (permalink)
Henrik Nystrom CEO     Join Date: Apr 2008	Quote: Originally Posted by Cyde Are you running window's vista? No, that would not work. We are running server OS. We believe we have norrowed it down to our ports. We will try some more things shortly that we hope will tell us what the issues are. Thanks!

Today, 21:56

#182 (permalink)

Henrik Nystrom CEO     Join Date: Apr 2008

Quote: Originally Posted by Mauzi Not getting a word from SV for days now really doesn't make look SV professional at all. Plus, the speak about BIOS fumbling surely doesn't help this either - a proper server doesn't need such. So we better not imagine what kinda hardware they use for running MO... Now add that proper hardware isn't expensive anymore today (even for servers), so having a replacement shouldn't an an issue at all... But then, they possibly havn't even narrowed down the issue yet at all. Looking at the talk about Telia having packet drops offers a wide variety of possible problems. Let's hope they find someone experienced to search for the problem else it will not be found within weeks... (need help?) You really try to make yourself look like an expert here. But fail miserably. Please consider that the reasons for 90% of broken circuits are either direct overheating or aging - which both are a result of occurring heat in electronic devices. Even the other mainly occurring ways of damaging circuits like electrostatic charging and mechanical damage are neglectable. We are doing our best communicating posting here several times each day now. We think we have narrowed it down now and going to test this very shortly, I hope we can get some final feedback and that it solves the issue we have here. Opal wished to update you further on whats going on as that would be better than not getting anything, He is pulling in me to get some info passed on to you guys, hence he's posts on that. It doesnt mean he is totally updated each thing we do and get that posted for you. I personally think its not easy to what kind of detailed level we should decide to share here on the community as much of it would not explain antyhing for an outside of the office. But I think its up to Opal to share information or not as it really doesnt affect us atm, I know some people will interpret it differently, some people will go of thinking we are doomed based on the info some just think its interesting to hear different progress. But I can assure you all we are doing our best and we got very experienced people working on the issue both within our server host provider and from Epic Games working with us on this issue. For those interested on what happend here Im sure Opal can sum it up and share it with you here when we confirmed and solved the issue. Thank you all.

 

 

Let's hope they can tie this down as mid May and the launch of DAWN is approaching!

Shabale

The server down of tonight was to fix yet another duping exploit.

HerculesSAS

Ports now, eh? I could debunk that one too, but I think the usual suspects will believe him, and I still know him to be lying. The real cause of the problem is "we don't have a damned clue".

 

Funny how a few hours after I debunked the entire notion of it being the hardware, they concocted another reason for it to be broken. LOL

Excalaber2

Originally posted by Heretique

Originally posted by HerculesSAS

Given that they outsource their servers from the hosting company, and that the hosting company uses SNMP to monitor fans, hard drives, temperatures, etc... this is TOTAL BS.

 

StarVault may own the servers, but they don't do the maintenance nor do they have to worry about it working. That's what they contract in their SLA to the hosting company. This is a standard hosting agreement, where the hosting company will monitor the servers and provide the "hands on" work because they are remote to SV.

 

Ordering new fans? You know that EVERY server (Dell, HP, IBM, etc) has monitoring systems within the server that throw indicator lights on the front or back (green for good, red for bad) to indicate that a fan has gone bad. And when they do go bad, the other fans spin FASTER to make up the difference until you get a replacement. Same with power supplies. The amount of redundancy in these systems is beyond what would make a server get too hot, and if the server did get too hot, it would simply turn off or die entirely due to thermal protection or a total overheat.

 

Oh, and for replacement parts for HP, Dell, and IBM... it's an ETA of 4-24 hours for most of Europe.

 

If you're going to make up a lie, at least know WTF you are talking about. But I expect no less from SV.

As a datacenter administrator I approve this message. Just another beat around the bush, wonder if SV actually knows what is wrong.

Guys, we are assuming this game server is actually a server and not a desktop PC.  I've seen worse at work.... (some guy tried to host their company's web server on a windows XP machine in iis on a wireless connection.  His machine periodically would go down and he didn't realize it was due to the power settings hibernating it.....lol...I wonder if it was even a desktop and not some laptop.....)

HerculesSAS

Originally posted by Excalaber2

Originally posted by Heretique

Originally posted by HerculesSAS

Given that they outsource their servers from the hosting company, and that the hosting company uses SNMP to monitor fans, hard drives, temperatures, etc... this is TOTAL BS.

 

StarVault may own the servers, but they don't do the maintenance nor do they have to worry about it working. That's what they contract in their SLA to the hosting company. This is a standard hosting agreement, where the hosting company will monitor the servers and provide the "hands on" work because they are remote to SV.

 

Ordering new fans? You know that EVERY server (Dell, HP, IBM, etc) has monitoring systems within the server that throw indicator lights on the front or back (green for good, red for bad) to indicate that a fan has gone bad. And when they do go bad, the other fans spin FASTER to make up the difference until you get a replacement. Same with power supplies. The amount of redundancy in these systems is beyond what would make a server get too hot, and if the server did get too hot, it would simply turn off or die entirely due to thermal protection or a total overheat.

 

Oh, and for replacement parts for HP, Dell, and IBM... it's an ETA of 4-24 hours for most of Europe.

 

If you're going to make up a lie, at least know WTF you are talking about. But I expect no less from SV.

As a datacenter administrator I approve this message. Just another beat around the bush, wonder if SV actually knows what is wrong.

Guys, we are assuming this game server is actually a server and not a desktop PC.  I've seen worse at work.... (some guy tried to host their company's web server on a windows XP machine in iis on a wireless connection.  His machine periodically would go down and he didn't realize it was due to the power settings hibernating it.....lol...I wonder if it was even a desktop and not some laptop.....)

 Colocation hosts don't allow putting desktops into server racks, because then their management time and expense are increased since they are responsible for the environment. And when you have clients that want to do stuff like that, you are already looking at a customer that you don't want.