RKS Server Update Thread

[PY004]

Notice to all: Servers will be offline for FN transfer and the MAR2011 patch install!

EDIT this has been completed now!


EDIT2
TX Server has crashed with a BIG BANG! I don't know what's wrong with it, but my host is currently looking at fixing the issue. I will keep this updated as I get more information.

EDIT3
TX Server is now operational.

 

[PY004]

A serious issue with Odyssey(One of the RKS Servers) was detected earlier today that requires immediate attention. Instead of attempting a fix which is expected to be quite complicated and time consuming, a decision to simply wipe every server and reinstall everything was reached. In the following days (specific dates to be announced as more information becomes available) all the servers will be wiped and the OS/Programs will be reinstalled. This is a long term project that is estimated to last a week or two, although most of the important service should be operational within 3 days, and RKS MSC server downtime is estimated to be less than a day.

The following tasks will be performed in order (TBA as plans are made).
•Plans not finalized yet - TBA

 

[PY004]

Final announcements
All TX (US Central) Servers are going offline on Friday afternoon.
FN will move to a new server on Thursday as a temporary measure. (All RKS MSC servers will be down during this period)
On Friday evening, RKS Server #2 (VA) will be reimaged.
Hopefully by Saturday evening, RKS #2 will be ready to be reconfigured. At that time, All RKS MSC servvers aside from the FN will go down as the central server software is reinstalled. This process will take a few hours.
All services should be restored by Sunday night.
RKS hosted FN will move back to Server 2 eventually.

 

[PY004]

Okay due to network problems this was delayed but here is the new revised schedule...

Monday Afternoon
• All RKS MSC Servers will go offline.
• RKS hosted FN server will migrate to a Phoenix as a temporary measure.
• All RKS MSC Servers less the TX(Central) will come online.

Monday Evening
• RKS #2 (VA Odyssey) will be sent in for reimaging.

Tuesday
• All RKS Servers will go offline.
• RKS Master server wll be reinstalled.
• RKS Slave servers will be associated with the Master.
• All RKS Servers will go online.

Eventually...
• All Auxillary services restored
• RKS hosted FN will move back to Server 2 eventually.

PS color codes frommy forums doesnt work that great here....

 

[PY004]

UK Server Possible downtime due to maintenance.. Read below for details.

On another note: For anyone who wishes to play on the RKS 2moons server... (Ogame clone - a web browser based game).
http://www.rkszone.com/apps/2moon/

Dear PY004,

Our utility provider will be performing required maintenance work to our electric sub-station. Power to the building from the grid will be turned off during the works, which is expected to take approximately 10 minutes. Prior to the work being carried out by our utility provider we will manually transfer load to the generators. I have outlined further details below:

Maintenance Window - We are setting a 1 hour window starting at
0800 GMT / 0900 CET on Wednesday, 20th April.

Expected Impact - We do not expect any outages to occur as a result of this work. Your solution should remain online and functional throughout the maintenance window. Although there is always a risk of outage in all electrical maintenance work, we want to assure you that our team has been diligent in its planning. Please be assured that we are conscientious in avoiding any risk of this happening but we feel that it is important to make you aware.

If you have any questions or concerns, please do not hesitate to contact our
24/7 Support team or submit a ticket at http://www.mypeer1.com.

You are a valued client and we appreciate your continued support.

Sincerely,

Mike Duncan
Data Centre Operations Manager (UK)
http://www.mypeer1.com | Managed Hosting 0800 840 7499 | ServerBeach 0800 840 7488

 

[zeus9860]

All RKS servers seem to be down, except for the US central servers right now. There was 1 US east a few hours ago but it vanished aswell. Maintenance going on im guessing?

 

[Thothie]

Two of the US Central servers (#10 and #6) and all of the US East Servers (#1-#3) went down. Restarted. The UK servers are down, but if they are in some sort of maintenance cycle, I dun wanna restart them. :\

 

[Keldorn]

Was away for the weekend, sorry.

Restarted the Europe servers:

Server 12 went down on The_keep due to no free edicts.
Server 13 went down on Dragooncaves due to no free edicts.
Server 14 went down on Thornlands, due to no free edicts.
Server 15 went down on Helena, due to no free edicts.
Server 16 went down on Calruin2, due to SV_Physics: bad movetype 1

It seems that "No free edicts" and "SV_Physics" errors need manual restarting.

 

[Thothie]

#16 (UK) went down to bad movetype on Calruin2.

I stupidly restarted the server without copying down the line - but it was traced to client.cpp - if ye get the line number in the error the next time you catch it, give me a heads up... Wondering if it has to do with stacking code - arrows getting the wrong movetype in the process, or some such.

 

[PY004]

Two of the US Central servers (#10 and #6) and all of the US East Servers (#1-#3) went down. Restarted. The UK servers are down, but if they are in some sort of maintenance cycle, I dun wanna restart them. :\

As long as the servers don't indicated "suspended" or "unknown",it's fine for you to attempt a restart (except when we're doing those large patches).

 

[Thothie]

I stupidly restarted the server without copying down the line - but it was traced to client.cpp - if ye get the line number in the error the next time you catch it, give me a heads up...

#13 went down to "ED_Alloc: no free edicts" today.

If it's "client.cpp:1697" that's the catch where it logs the error. While that isn't useful it itself, since it can capture general server-exit errors there, I'm hoping maybe I can force a "clean exit" there, to avoid the "pop-up" hang, at least.

 

[Keldorn]

#12 went down after 4 people voted to Heras from Edana.

There was no error shown in the log.

#14 went down on Helena due to no free edicts.

.\client.cpp:1697 SYS_ERROR: ED_Alloc: no free edicts

 

[PY004]

RKS FN Server, and Some of the RKS MSC servers will go down today within the next 30 minutes to replace a degraded RAID array.

The process should be done in 20-40 minutes.
EDIT: Done.

 

[PY004]

FN is down at the moment.

I f***ed up with restoring the RAID array.
Fix should be coming soon. Sorry! lol

 

[PY004]

Update: The new HDD that was installed to replace the failed HDD array was not properly cleansed by my host and contained a boot manager. As such, the server is attempting to boot off the replacement HDD since the server was restarted today morning to get it into the RAID manager so that I can add the HDD as a replacement disk in the RAID manager.

 

[ceriux]

just wanted to mention how much i enjoy and appreciate your servers! best server i'v been on for msc! my ping at the lowest is like 35 back in the day i was lucky if it was 120.

 

[PY004]

@ceriux
Thank you so much for your support!!! It's greatly appreciated.

@Everyone else...

RKS servers have been (or is in the process of being) updated to the JUN2011a patch. There may be issues with some of the servers. Any issues should be reported here since I currently am on a laptop that does not have HL/MSC installed.

 

[Thothie]

There should be less incidents of RKS servers going down and failing to come back up, as I've tweaked it so "fatal popup" errors do not give pop-ups - but instead exit clean.

I shoulda likely made that a cvar option or something, as it has the downside that you'll have no idea why your server crashed. :\

 

[PY004]

viewtopic.php?f=6&t=8801

 

[PY004]

Update...
RKS Euro servers have been caught up in customs for almost a month now.
It was getting ridiculous, so finally the servers are on their way back.
I've instead gone for renting a dedicated instead of colocating, and the servers should be up within a week.

 

[PY004]

RKS Euro Test Server Online at 46.182.106.54:27015 - 27018
Hosted in Amsterdam
Intel Xeon E3-1230 Processor / 8GB RAM
Note: These are new servers. There may be frequent restarts without notice.

RKS Central Servers are still the same specs
Dual Intel Xeon E5620 Processors /12 or 24GB RAM / 15k RPM SAS HDD in RAID / 1 Gbps Uplink

EDIT: I don't really play MSC that much, so I cannot determine if the servers are working properly without your help! If you notice anything wrong with the servers, PLEASE let me know! I want to make these servers work as best as possible. However, complaining about it in the server chat or sending me hate e-mails from anonymous mailing services filled with profanity are not doing anything good if you don't tell me what's wrong with it.

Note: Most issues with the US Chicago server was the network, which has since been resolved as far as I know. There hasn't been any problems on my minecraft servers, nor on my TF2 servers. If there are any problems with those, please let me knwo about those also.

 

[PY004]

EU Servers down due to network issues. Waiting for Datacenter to respond.